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EXECUTIVE  SUMMARY 


The  Air  Force  has  experienced  low  operational  reliability  on 
numerous  aircraft  electronic  units.  Poor  quality  control  by  the 
unit  manufacturers  and/or  the  acceptance  of  low  process  yields 
are  stated  as  the  major  contributors  to  this  problem. 

If  this  premise  is  true,  the  existence  of  a  significant 
relationship  between  manufacturers'  unit  yields  and  the  subse¬ 
quent  operational  (field)  failure  rates  for  these  units  would 
provide  a  basis  for  revising  current  DoD  policies  and  practices 
on  acquisition  of  electronic  units  and  the  subsequent  warranties 
of  these  units.  This  relationship  could  be  used  by  the  Air  Force 
Systems  Command  (AFSC)  in  Production  Readiness  Reviews  (PRRs)  and 
Risk  Assessments  to  estimate  the  potential  effects  of  the  unit  on 
the  future  operational  readiness  of  tactical  aircraft  systems. 

The  prime  objective  of  this  research  is  to  determine  the 
degree  of  correlation  between  manufacturing  yields  and  the  opera¬ 
tional  reliability  of  selected  electronic  units.  In  Phase  I,  the 
data  base  for  a  selected  group  of  line  replaceable  units  is 
established.  In  Phase  II,  the  degree  of  correlation  among  these 
data  will  be  assessed.  Based  on  the  degree  of  this  correlation, 
guidelines  to  use  this  information  in  the  Air  Force  Production 
Readiness  Reviews  (PRRs)  will  be  developed  in  Phase  III. 

The  completed  events  of  Phase  I  demonstrate  the  limited 
availability  of  data  to  support  the  intended  analyses  of  Phase 
II.  There  are  ample  data  on  operational  reliability  of  the 
selected  units  over  the  time  period  of  interest,  but  all  units 
are  not  equally  covered.  Also,  there  is  an  imbalance  of  data  on 
yield  and  rework  in  comparison  to  operational  reliability  data. 

Section  1  of  this  report  describes  the  problem  and  research 
objectives.  A  discussion  of  the  objectives  to  concentrate  on 
printed  circuit  boards  within  the  pilot  units  is  provided. 

Section  2  provides  definitions  of  key  variables,  gives  the 
data  gathering  plan,  the  research  data  base,  data  sources  and  the 
key  problems  encountered  in  the  data  collection  phase. 
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Section  3  gives  a  description  of  the  data  collected  in  the 
context  of  how  these  data  will  be  used  in  the  analyses  of  Phase 
ZZ.  Prime  emphasis  is  devoted  to  a  discussion  of  measurable  para¬ 
meters,  such  as  failure  rates  and  "mean  time  between  failure" 
( MTBF)  as  the  dominant  variables  reflecting  operational  relia¬ 
bility  of  a  given  unit.  There  are  exceedingly  wide  variations  in 
the  computation  and  interpretation  of  these  variables  in  both 
government  and  industry. 

The  opinions  stated  herein  are  those  of  the  researchers  and 
are  not  necessarily  intended  to  reflect  Air  Force  policies  con¬ 
cerning  the  analysis  of  test  and  operational  reliability  data. 


TABLE  OF  CONTENTS 


Page 

REPORT  DOCUMENTATION  PAGE  (DD  FORM  1473) 

EXECUTIVE  SUMMARY  1 

TABLE  OF  CONTENTS  3 

LIST  OF  ILLUSTRATIONS  5 

SECTION 

1.  INTRODUCTION  6 

1.1  Problem  Overview  6 

1.2  Research  Objectives  6 

1.3  Phase  I  Requirements  (Work  Tasks)  7 

1.4  Conclusions  on  Data  Availability  7 

1.4.1  Operational  Data  7 

1.4.2  Rework  Data  9 

1.4.3  Yield  Data  9 

1.5  Phase  I  Summary  10 

2.  PHASE  I  DATA  COLLECTION  11 

2.1  Research  Data  Base  Structure  11 

2.1.1  Definition  of  Unit  Failure  11 

2.1.2  Measures  of  Unit  Reliability  11 

2.1.3  Measures  of  Unit  Yield  11 

2.1.4  Measures  of  Unit  Rework  12 

2.2  Phase  I  Data  Gathering  Plan  13 

2.3  Prime  Data  Sources  Used  in  Phase  I  13 

2.3.1  Unit  Test/Yield  Data  13 

2.3.2  Reliability  and  Rework  Data  14 

2.3.3  Other  Sources  of  Data  15 

2.4  Primary  Data  Collection  Problems  16 

2.4.1  Operational  Reliability  Data  16 

2.4.2  Unit  Yield  Data  17 

2.5  Need  for  Additional  Data  18 

2.5.1  Need  for  Expanded  Data  Base  18 

2.5.2  Revised  Data  Collection  Strategy  18 

2.5.3  Relating  PCB  Repair  Data  to  LRUs  22 

2.5.4  Measuring  Key  Operational  Parameters  23 


3 


3.  DESCRIPTION  OF  EXPLANATION  OF  DATA  COLLECTED 

3.1  Data  Description  Overview 

3.2  Operational  Reliability  Data 

3.2.1  Observations  Concerning  MTBF/M 

3.2.2  Analysis  of  MTBF/M  Trends 

3.2.3  Mission  Influences  on  Parameters 

3.2.4  Test  and  Operational  MTBF 

3.3  Manufacturers'  Unit  Yield  Data 

3.3.1  Types  of  Data  Available 

3.3.2  Discussion  of  Test/Yield  Data 

3.4  Data  on  Unit  Rework  Data 

3.4.1  Rework  at  the  LRU  Level 

3.4.2  Rework  at  the  PCB/SRU  Level 

3.5  Other  Supporting  Data 
APPENDICES 


LIST  OF  ILLUSTRATIONS 


Page 

Figure 

1 

MTBF  Plot  Versus  Time  (A10-65AA0) 

28 

2 

MTBM-1  Trends 

31 

3 

MTBM-Total  Trends 

32 

4 

Test  versus  Operational  MTBF  Trend 

34 

5 

MTBF  Ratio  versus  Time 

36 

6 

Derived  Measure  of  Rework 

44 

7 

Failure  Distribution  (WUC  513A0) 

47 

8a 

Failure  Distribution  (WUC  513H0) 

49 

8b 

Failure  Distribution  (WUC  513H0) 

49 

9 

Time  Series  Failure  Pattern  (WUC  513U0) 

50 

10 

Failure  Pattern  (Trend  Removed) 

51 

Table 

1 

Selected  Set  of  Work  Unit  Codes 

8 

2 

Data  Stratification  by  A/C  &  WUC 

21 

Exhibits 

1  Composite  MTBF  (F-15  Avionics)  37 

2  Test  Data  (Unit  Yield)  39 

3  Test  Data  (APX-101  WUC-65AA0)  40 

4  Test  Data  (F15,  General)  42 


5 


SECTION  1- INTRODUCTION 


1 . 1  PROBLEM  STATEMENT 

The  Air  Force  has  experienced  low  operational  reliability  on 
numerous  aircraft  electronic  units.  One  premise  is  that  a  major 
contributor  to  this  problem  is  poor  quality  control  by  the  unit 
manufacturers  and/or  the  acceptance  of  low  process  yields.  The 
effect  of  this  situation  is  the  acceptance  of  unit  process  yields 
that  decrease  the  probability  that  the  average  unit  .  will  perform 
as  expected. 

If  this  premise  is  true,  the  existence  of  a  significant 
relationship  between  manufacturers'  unit  yields  and  operational 
(field)  failure  rates  would  provide  a  basis  for  revising  current 
DoD  policies  and  practices  on  acquisition  of  electronic  units  and 
the  subsequent  warranties  of  these  units.  This  relationship 
could  be  used  by  the  Air  Force  Systems  Command  (AFSC)  in  Produc¬ 
tion  Readiness  Reviews  (PRRs)  and  Risk  Assessments  to  estimate 
the  potential  effects  of  the  unit  on  future  operational  readiness 
capability  of  aircraft  systems. 

1 . 2  RESEARCH  OBJECTIVES 

The  objectives  of  this  research  as  stated  in  the  Statement 
of  Work  are: 

a.  Phase  I:  Determine  the  availability  of  information  and 
data  on  the  manufacturing  yields  and  operational  reliability  of  a 
specific  set  of  electronic  units  listed  in  Table  1; 

b.  Phase  II:  If  the  data  are  available,  determine  if  there 
is  a  correlation  between  the  manufacturing  yield  and  operational 
reliability  of  these  specific  electronic  units; 

c.  Phase  III:  If  there  is  a  significant  correlation, 
determine  what  guidelines  can  be  used  to  identify  when  process 
yields  are  "in  control"  and  what  manufacturing  yield  problems  are 
likely  to  persist  during  the  production  and  operation  phases  of 
these  specific  electronic  units. 

As  an  end  product,  this  research  will  identify  factors  and 
affecting  low  operational  reliability  of  selected  electronic 
units  and  develop  statistical  indicators  for  use  by  AFSC  during 
Production  Readiness  Reviews  and  Risk  Assessments. 
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1.3  PHASE  I  REQUIREMENTS  (WORK  TASKS) 

a.  Determine  the  availability  of  information  and  data  on 
the  manufacturing  yields  of  electronic  Line  Replaceable  Units 
(LRUs)  listed  in  Table  1,  and  their  respective  electronic  Shop 
Replaceable  Units  (SRUs)  for  the  period  1  January  1980  through  31 
December  1981  (24  months). 

b.  Determine  the  availability  of  information  and  data  on 
the  operational  reliability  of  the  electronic  LRUs  in  Table  1  and 
their  respective  electronic  SRUs  for  the  period  1  April  1980 
through  31  March  1982  (24  months). 

c.  If  the  data  mentioned  in  (a)  and  (b)  are  available, 
collect  information  for  the  periods  specified  and  submit  these 
data  along  with  the  draft  Phase  I  final  report. 

This  research  executes  Contract  F-33615-82-R-5097  at  the 
University  of  Dayton  (UD)  School  of  Engineering.  This  contract 
is  sponsored  by  the  Air  Force  Business  Research  Management  Center 
(AFBRMC)  at  Wright  Patterson  AFB,  Ohio,  and  the  Air  Force  Project 
Manager  for  this  effort  is  Lt.  Joseph  Peck. 

1.4  CONCLUSIONS  ON  PHASE  I  DATA  AVAILABILITY 

1.4.1  Availability  af  Operational  Reliability  Data 

On  the  basis  of  data  and  information  collected  in 
Phase  I,  sufficient  time-related  data  (24  or  more  months)  are 
available  on  the  operational  reliability  of  each  one  of  the 
selected  LRUs  in  Table  1  to  support  Phase  II  execution.  The 
primary  variables  of  interest  are  mean  time  between  failure 
(MTBF) ,  mean  time  between  maintenance  (MTBM) ,  failures  per  unit 
period  and  unscheduled  manhours  expended  for  the  related 
failures.  Changes  in  the  AFLC  definition  and  computation  of  MTBF 
and  MTBM  have  occurred  within  the  time  period  of  interest  to  this 
research  and  the  effect  of  these  changes  are  noted  herein. 

The  singular  source  of  extensive  data  on  unit  reli¬ 
ability  is  the  Air  Force  Logistics  Command  (AFLC)  DO-56  report 
maintained  by  AFLC/LOEP.  Copies  of  the  required  operational 
reliability  data  for  each  LRU  are  available  on  ultrafiche  at  the 
University  of  Dayton. 
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1.4.2  Availability  of  LRU/SRU  Rework  Data 

Data  related  to  unscheduled  manhours  expended  for 
base-level  maintenance  of  all  of  the  selected  LRUs  are  included 
in  the  DO-56  B-05,  B-06,  B-22  ,  B-23,  C-02  and  C-03  reports, 
which  are  available  on  ultrafiche  at  the  University  of  Dayton. 
However,  within  the  AFLC  DO-56  system,  manhour  data  for  the 
repair  of  SRUs  at  the  AFLC  depots  cannot  be  directly  linked  to  a 
specific  Work  Unit  Code  (WUC)  or  aircraft  system.  This  problem 
can  be  solved  as  described  in  paragraph  2.5.3. 

1.4.3  AvailabilLty-sf-L&UZSRU  Test/Yield-Informa-tion 

There  are  accessible,  time  sequenced  data  and  infor¬ 
mation  that  can  be  used  to  compute  manufacturing  yields  for  eight 
(8)  of  the  18  selected  LRUs/WUCs  in  Table  1  (mainly  for  the  F-15 
and  F16).  These  data  are  derived  from  manufacturer's  Reliability 
Qualification  Testing  (RQT)  and  Production  Readiness  Testing 
( PRT)  . 

The  required  data  for  the  F4  and  AlO  are  spotty  over 
the  relevant  time  period  due  mainly  to  the  maturity  of  the 
selected  LRUs/WUCs.  But  the  available  data  can  be  further 
augmented  by  extending  the  data  collection  to  other  electronic 
units  for  which  sample  test  information  and  data  have  been 
routinely  maintained  (See  paragraph  2.5.1). 

Extending  the  test/yield  data  base  to  the  printed 
circuit  boards  (PCBs)  used  to  repair  the  selected  LRUs  in  Table  1 
represents  a  extended  problem  for  several  reasons.  First,  data 
from  manufacturers'  functional  testing  do  not  currently  account 
for  test  failure  statistics  at  the  SRU/PCB  level  in  a  way  that  is 
upwards  relatable  to  a  specific  LRU/WUC.  Second,  it  is  typical 
for  two  or  more  levels  of  manufacturer  subcontracting  to  be 
involved  in  the  design  and  supply  of  PCBs  for  major  subsystems, 
such  as  the  F-15  and  F-16  avionics.  Third,  it  is  not  unusual  tor 
equipment  testing  to  greatly  lag  production  and  delivery. 

Such  factors  may  negate  the  use  of  PCB  failure  data 
from  being  linked  "directly"  to  the  operational  reliability  a 
specific  LRU.  Thus  a  working  premise  of  this  research  is  to 
first  seek  correlations  between  LRU  test  data  and  operational 


9 


e  * 


reliability,  and  then  seek  correlations  between  PCB  yield  and 
rework  activity  and  unit  test  reliability.  The  objective  of  this 
research  is  accordingly  partitioned  into  two  interrelated  parts. 

1.5  PHASE  I  SUMMARY 

There  are  sufficient  data  to  support  extension  of  this 
research  to  Phase  II.  The  key  limitation  of  these  data  is  an 
imbalance  of  time-related  data  on  operational  reliability  and 
rework  actions  in  comparison  to  the  amount  of  corresponding  data 
about  production  and  manufacturing  yield  of  the  selected  units 
and/or  the  shop  replaceable  units  used  to  repair  these  units 
(namely,  PCBs). 

This  limitation  can  be  resolved  by  expanding  the  population 
of  selected  LRUs.  This  expansion  would  also  strengthen  the 
statistical  foundation  of  this  study  results,  which  are  intended 
to  apply  to  the  general  population  of  avionic  units  of  tactical 
aircraft  systems. 


SECTION  2  -  PHASE  I  DATA  COLLECTION 


2.1  RESEARCH  DATA  BASE  STRUCTURE 

The  objective  of  this  research  is  to  determine  if  a  signifi¬ 
cant  relationship  exists  among  three  variables,  unit  field  relia¬ 
bility,  unit  yields  and  rework  activity  related  to  printed  cir¬ 
cuit  boards  (PCBs)  used  to  maintain  selected  avionic  systems.  In 
this  section,  parameter  definitions  and  the  data  collection  pro¬ 
cess  needed  to  measure  each  of  these  variables  are  described. 

The  intent  of  this  section  is  to  assure  that  the  data 
collection  process  is  expressly  directed  towards  the  measurement 
of  variables  that  have  meaning  in  the  AFSC/AFLC  environment,  and 
that  these  variables  can  be  measured  with  the  data  available. 

2.1.1  Definition  of  Unit-Failure 

The  primary  logistic  event  of  interest  to  this 
research  is  a  "unit  failure".  Typically,  "failure"  means  that  the 
item  is  incapable  of  performing  its  intended  function.  Varying 
degrees  of  this  incapability  are  classified  as  "malfunctions". 
For  this  research,  the  accepted  definition  and  usage  of  the  term 
"unit  failure"  conforms  with  that  used  in  the  AFLC  Maintenance 
Data  Collection  System,  which  is  a  function  of  the  system  of 
maintenance  and  action  codes  in  Appendix  IV. 

2.1.2  Measures  of  Unit  Field  Reliability 

The  computed  "mean  time  between  failures"  (MTBF)  in 
the  AFLC  DO-56  (Product  Performance  System)  B-05  report  is  the 
key  variable  that  measures  unit  field  reliability,  although  the 
credibility  in  this  parameter  as  a  sufficient  measure  of  opera¬ 
tional  reliability  is  universally  low.  (The  reason  for  this 
dilemma  is  explained  in  more  detail  in  Section  3). 

Another  parameter  is  "mean  time  between  maintenance" 
(MTBM),  and  due  to  the  recent  change  in  terminology  within  the 
DO-56  system,  the  computed  values  of  MTBM  are  strongly  correlated 
to  the  computed  or  estimated  MTBF,  as  shown  in  Section  3.2.1. 

2.1.3  Measures  of  Unit  Yield 

"First  pass"  unit  yield  is  defined  as  the  number  of 
units  passing  functional  testing  on  the  first  trial.  In  general, 
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"functional  testing"  consists  of  operating  the  unit  for  a  speci¬ 
fied  period  of  time  equal  to  a  percent  (usually  10%)  of  its 
design  MTBF.  The  data  required  for  such  computations  are  cumula¬ 
tive  inventory  and  the  number  of  units  whose  operating  times  to 
failure  were  less  than  the  specified  percentage. 

The  "desired"  data  to  measure  the  yield  variable  are 
test  data,  where  unit  functional  test  failures  are  uniquely 
related  to  inventory  changes  for  each  production  "lot".  The  data 
are  derived  from  manufacturers  Reliability  Qualification  and 
Acceptance  Tests  (RQAT)  and/or  Production  Reliability  Tests 
(PRT).  Such  test  data  exist  and  are  available  for  some  of  the 
selected  units,  but  are  limited  for  other  units  for  the  time 
period  of  interest. 

In  terms  of  "available"  data  in  the  DO-56  B-05 
report,  the  inventory  of  the  higher  assembly  for  each  of  the 
pilots  units  is  available  by  month.  Within  DO-56,  the  closest 
category  of  unit  data  that  relate  to  "premature"  unit  failures 
pertain  to  "inherent  malfunctions".  Therefore,  the  number  of 
"inherent  malfunctions  per  unit  change  in  unit  inventory"  may  be 
a  computable  measure  of  unit  yield  from  the  "operational"  point 
of  view. 

2.1.4  Measures  of  Unit  Rework 

For  printed  circuit  boards,  "rework  rate"  is  typi¬ 
cally  defined  as  the  ratio  of  the  number  of  first-time  success¬ 
fully  tested  boards  to  the  total  number  of  units  tested.  This 
definition  applies  mainly  to  a  PCB  manufacturing  environment,  but 
tends  to  be  impractical  as  a  useful  measure  of  repair  at  the  AFLC 
Air  Logistics  Centers  (ALCs) ,  since  PCBs  are  treated  as  other 
reparable  units  to  the  degree  that  designs  permit.  "Manhours 
expended  per  PCB  failure"  appears  to  be  a  more  functional  measure 
of  rework  at  the  operational  level. 

Relevant  data  to  determine  the  rework  volume,  or 
repair  rate,  of  shop  replaceable  units  (SRUs)  are  reflected  in 
"unscheduled"  manhours  at  base  level,  and  "manhours"  at  depot 
level  in  the  DO-56  B-06  and  C-03  reports  respectively.  But  the 
key  problem  as  related  to  this  research  is  establishing  a  unique 
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linkage  of  manhour  expenditure  data  for  SRU  repair  at  the  depot 
to  a  specific  work  unit  or  LRU  at  base/field  level  (This  issue  is 
discussed  further  in  Section  3.5.3). 


2.2  PHASE  I  DATA  GATHERING  PLAN 

The  Phase  I  data  collection  plan  was  designed  to  use  two 
separate  sources  to  obtain  the  operational  and  production  test 
and/or  yield  data  for  the  set  of  pilot  electronic  units  shown  in 
Table  1.-  The  primary  source  of  operational  reliability  and 
rework  (manhour)  data  is  the  AFLC  DO-56  reports  (B  and  C)  gene¬ 
rated  from  the  AFM  66-1  data  of  the  Air  Force  Maintenance  Data 
Collection  System  (see  samples  of  these  reports  in  Appendix  IV). 

The  primary  sources  of  production  reliability  data  are  the 
manufacturers'  continuing  test  data  for  selected  units  that  are 
involved  in  Reliability  Qualification  Testings  (RQT)  and/or 
Production  Reliability  Testing  (PRT) .  Other  names  for  similar 
test  are  "All  Equipment  Production  Reliability  Test"  (AEPRT)  and 
Environmental  Stress  Screening  (ESS).  These  test  data  are  man¬ 
dated  by  various  MIL  STDs  and  are  routinely  supplied  to  the 
government  by  unit  manufacturers. 

2.3  PRIME  DATA  SOURCES  USED  IN  PHASE  I 

2.3.1  Manufacturft£s.L-mut_rag.t/YieI.d.  Data 

Contacts  with  seven  contractors/vendors  of  selected 
pilot  units  were  established  to  obtain  the  required  test  and 
yield  data  for  this  research. 

Teledyne  produces  the  transponder  receiver  (APX  101, 
Work  Unit  65AA0)  used  on  the  A-10,  F-15  and  F-16.  A  sample  of  the 
data  provided  by  Teledyne  is  shown  in  Appendix  II.  Similar 
contacts  were  made  with  Honeywell  Aerospace  Defense  Group  (ADG) 
in  Tampa,  FL  which  makes  a  wide  range  of  PCBs  for  a  variety  of 
military  systems.  Another  Honeywell  data  source,  is  the  Corporate 
Reliability  Center  for  Electronic  Components  in  Minneapolis. 

Contact  was  made  with  Systems  Research  Laboratories 
(SRL)  in  Beavercreek,  Ohio  for  data  involving  PCB  yields  during 
manufacturing.  Similar  contacts  have  been  established  with  Opti- 
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Gauge  Quality  Circuits  in  Trotwood,  Ohio  and  Texas  Instruments  in 
Dallas,  Texas. 

Mr.  Jerry  Edwards  (ASD/TAEE)  provided  contractor- 
developed  data  on  the  reliability  testing  of  five  of  the  units 
used  on  the  A10  and  F15  (see  Exhibits  1,  2  and  3).  Mr.  Edwards 
is  a  Reliability  Engineer  for  the  Tactical  Systems  Division  (TA) 
and  maintains  a  comprehensive  collection  of  test  and  yield  data 
related  to  this  research.  Captain  Robert  Russell,  ASD/YPEC 
maintains  the  RQT  and  PRT  test  data  bases  for  the  J-16. 

2.3.2  Operational  Reliability  and  Rework  Data 

Computer  data  tapes  were  formally  requested  from  APLC 
(through  AFBRMC)  that  generate  the  DO-56  reports  for  the  time 
duration  and  applicable  aircraft  for  the  pilot  set  of  electrical 
units  specified  in  Table  1.  Repair  manhours  for  repair  of  each 
of  the  selected  units  are  available  on  the  DO-56  "B"  and  "C" 
reports,  but  as  explained  further  in  2.5.3  below,  these  manhours 
cannot  be  uniquely  retraced  to  the  LRU  from  which  the  relevant 
PCB  was  removed. 

Although  these  tapes  were  not  received  during  Phase 
I,  all  of  the  relevant  unit  data  on  ultra-fiche  were  obtained 
from  Mr.  Neuman  ( AFLC/LOEP) .  Over  300  sets  of  ultrafiche  (about 
2800  pages  of  data)  have  been  obtained  for  the  DO-56  outputs  for 
each  of  the  pilot  items,  dating  back  to  1977  for  the  F-4  and  A10 
aircraft.  The  required  data  for  all  of  the  selected  units  were 
manually  extracted  using  over  550  pages  of  these  reports.  Also, 
a  monthly  sequence  of  printouts,  entitled  "Selected  Work  Unit 
Maintenance  Summaries"  have  been  made  available  by  AFLC  on  a 
continuing  basis  for  each  of  the  pilot  WUCs  in  Table  1. 

At  WPAFB,  the  field  reliability  and  rework  data 
for  PCBs  at  the  PRAM  PO  were  examined  to  give  the  researchers 
insight  into  the  nature  of  actual  PCB  rework  at  the  AFLC  depots 
or  manufacturers'  facilities.  Also,  from  DESC,  an  extensive  set 
of  failed  printed  circuit  assemblies  have  been  obtained  that 
demonstrate  the  most  typical  failure  modes  of  these  assemblies 
(reference:  Mr.  A1  Crockett,  513-296-6234). 


At  Warner  Robins  Air  Logistics  Center  (WRALC), 
which  is  the  depot  for  the  maintenance  of  the  APX  101  for  the 
A10,  the  prime  contact  is  a  Maintenance  Technician,  Mr.  H.  C. 
Puckett,  who  is  directly  responsible  for  the  maintenance  actions 
on  the  circuit  card  assemblies  related  to  the  APX  101. 

2.3.3  Qth.er  Sources  of  Data 

An  especially  pertinent  study,  entitled  "Failure 
Analysis  of  the  5900  Federal  Stock  Class"  (AFIT  SL  Masters 
Thesis,  76-21)  provides  a  classification  of  LRU  failures  as 
reported  in  a  sample  of  over  320  "Quality  Deficiency  Reports"  in 
FSC  5900  (Hardware-Electrical  and  Electronic)  at  the  Defense 
Electronic  Supply  Center  (DESC) ,  Dayton,  Ohio.  This  study  con¬ 
cludes  that  over  53%  of  these  failures  could  be  attributed  to 
"manufacturer  or  latent  and/or  random  causes". 

A  study  by  George  Kerns  of  Hughes  Aircraft,  entitled 
"Non-operational  Failure  Rates  for  Avionic  Equipment"  attributes 
over  20%  of  failures  in  avionic  equipment  to  "non-operational" 
causes,  which  are  causes  not  associated  with  the  length  of 
operating  time  of  the  equipment.  The  magnitude  of  these  non¬ 
operating  failures,  Kern  states,  causes  a  bias  in  the  computation 
of  operational  MTBF  on  the  low  side,  so  that  the  ratio  of 
predicted  to  operational  MTBF  may  range  up  to  20:1. 

An  overview  of  the  "Production  Verification  Testing 
(PVT)"  concept  is  presented  in  a  brief  paper  by  Capt.  Keith 
Matthews.  According  to  Matthews,  PVT  is  intended  to  improved  the 
probability  of  delivered  systems  meeting  their  design  relia¬ 
bility.  He  also  states  that  "...the  relationship  between  testing 
and  field  reliability  was  not  quantifiable".  Mr.  Paul  Logus 
(ASD/AXP)  was  contacted  on  the  application  of  documented  results 
of  PVT  to  this  research. 

A  paper  by  Dillard  and  Frank  of  the  DoD  product 
Engineering  Services  Office  (DPESO) ,  entitled,  "An  Exploration  of 
the  Relationship  Between  Manufacturing  Rework  Events  and  Field 
Failure  Rate"  poses  the  hypothesis  "...is  there  a  relationship 
among  product  yield,  unit  complexity  and  operational  reliabil¬ 
ity?"  However,  no  formidable  results  supporting  this  hypothesis 


are  provided  in  this  paper.  The  key  emphasis  of  this  study  is 
the  repair  of  PCBs  of  varying  degrees  of  complexity  (which  is 
measured  in  terms  of  board  layers  and  density  of  discrete  units 
thereon).  The  authors  state  that  the  Air  Force  66-1  data  system 
(that  generates  DO-56)  is  inadequate  to  support  the  data  needed 
for  the  computation  of  MTBF  of  such  units  as  PCBs. 

MIL  STDs  217,  781C  and  756B  were  reviewed  to  assess 
test  data  requirements  for  electronic  units  and  the  requirements 
for  manufacturers  to  continually  supply  unit  test  data  to  the 
government  during  the  production  of  the  unit.  MIL-P-55110 
provides  a  listing  of  certified  manufacturers  for  printed 
circuits.  MIL-P-13949  gives  specifications  for  a  wide  variety  of 
PCBs. 

Data  in  the  Government  Industry  Data  Exchange  Program 
(GIDEP)  sources  were  reviewed  for  selective  electronic  unit 
reliability  data.  There  are  currently  three  sources  of  data  on 
GIDEP  at  WPAFB:  Bldg  22  (DTIC);  AFIT(Mr.  Rehg)  and  ASD/EN  (Mr. 
Massey).  The  GIDEP  data  base  (Failure  Exchange)  contains  generic 
data  on  PCB's  in  a  test  environment,  and  some  of  the  PCBs  can  be 
matched  by  stock  number.  Application  for  GIDEP  membership  at  the 
University  of  Dayton  has  been  made,  so  that  future  reliability 
data  in  each  of  the  data  bases  can  be  obtained  directly. 

2.4.  PRIMARY  DATA  COLLECTION  PROBLEMS  IN  PHASE  I 

2.4.1  Operational  Reliability  Data  on  Computer  Tape 

Although  extensive  operational  reliability  data  on 
ultrafiche  were  obtained  from  AFLC/LOEP  on  all  of  the  selected 
units  listed  in  Table  1,  these  data  could  not  be  obtained  in 
computer  readable  format  within  the  time  limit  of  execution  of 
Phase  I. 

Accordingly,  all  data  used  in  this  report  had  to  be 
manually  extracted  from  ultra-fiche.  Nevertheless,  the  need  for 
computer  based  data  analysis  is  accented  by  the  sheer  volume  of 
unit  reliability  data  to  be  scanned  to  structure  a  solid  data 
base  to  support  the  statistical  analyses  planned  in  Phase  II. 
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2.4.2 


A  sample  of  data  obtained  from  TELEDYNE  on  production 
testing  and  reliability  for  three  of  the  work  unit  codes  is  shown 
in  Appendix  II.  Three  other  vendor/manufacturers  contacted  stated 
that  such  data  in  the  detail  desired  for  this  research  existed 
only  at  government  sources,  such  as  the  Item  or  System  Managers 
at  the  Air  Logistics  Centers  (ALCs). 

There  are  two  key  reasons  for  this  apparent  dilemma. 
First,  some  of  the  selected  units  (for  the  A10  and  F4)  in  Table  1 
are  relatively  "old"  and  during  the  pre-production  testing 
stages,  the  contractor  or  manufacturer  routinely  turned  over 
testing  and  reliability  data  for  these  units  to  the  Air  Force  as 
specific  requirements  dictated  by  MIL  STDs  217,  470,  781C  and 
780,  etc.,  (which  pertain  to  reliability  qualification  and  pro¬ 
duction  acceptance  tests  for  electronic  units). 

Second,  after  the  operational  production  of  a  unit 
begins,  manufacturers  tend  to  rely  solely  on  AFLC-derived  infor¬ 
mation  (DO-56  reports)  to  assess  the  operational  performance  of  a 
given  unit,  although  there  are  explicit  requirements  (MIL  STD 
781C)  that  manufacturers  maintain  continual  post-production  test 
and  reliability  data  for  each  unit.  This  requirement  is  particu¬ 
larly  enforced  if  the  item  is  government  furnished  equipment 
(GFE)  or  if  the  unit  is  involved  in  a  "Quality  Deficiency  Report" 
(QDR)  or  an  engineering  change  proposal  (ECP). 

However,  continuous  tracking  of  data  on  reliability 
and  test/yield  for  a  unit  is  usually  done  only  if  the  unit  is,  or 
is  expected  to  become,  a  "problem  item"  as  evidenced  by  an 
increasing  failure  rate  or  its  design  complexity. 

Nevertheless,  the  primary  research  problem  in  Phase  I 
was  locating  "the"  individual,  such  as  an  Item  or  Systems  Manager 
or  Equipment  Specialist  at  the  Air  Logistics  Centers  (ALCs) 
having  cognizance  of  specific  data  on  a  specific  unit,  since 
there  is  (or,  at  least  appears  to  be)  no  formal  requirement  that 
these  test  data  be  kept  at  the  ALC  for  continuous  unit  reliabi¬ 
lity  assessment  and/or  verification  as  time  evolves. 


To  help  resolve  this  problem,  backup  sources  for  the 
manufacturers'  reliability  and  test  data  for  selected  units  at 
each  of  the  System  Program  Offices  at  ASD  for  each  aircraft  (A10, 
F4,  F15  and  F16)  had  to  be  used.  These  sources  were  the  relia¬ 
bility  engineers  for  these  systems,  but  the  lists  of  units  for 
which  relevant  test  data  is  kept  were  limited,  and  did  not  cover 
all  of  the  pilot  items  in  Table  1. 

2.5  NEED  FOR  ADDITIONAL  DATA 

In  this  section,  a  brief  discussion  is  provided  to  establish 
the  basis  for  an  expanded  research  data  base  and  the  need  to 
capture  key  operational  influences  of  the  pilot  units  through  the 
use  of  additional  measured  parameters.  Specifically,  there  is  a 
need  to  restructure  and  increase  the  sample  size  of  the  pilot  set 
of  units  to  provide  a  more  formidable  basis  for  the  mathematical 
conclusions  to  be  derived  in  the  Phase  II  analyses. 

2.5.1  Need  for  Expanded.  Data -Base 

There  are  additional  avionic  units  for  which  data 
are  routinely  maintained,  which  would  be  excellent  candidates  to 
be  added  to  the  pilot  list  for  subsequent  analyses  in  Phase  II. 
For  example,  during  the  week  of  19  November  1982,  a  "high  level" 
Air  Force  (PACAF)  request  to  AFLC  was  made  to  develop  "logistical 
synopses"  of  approximately  50  electronic  units  (WUCs)  that  were 
labelled  "war  stoppers".  In  fact,  the  identical  unit  reliability 
histories  as  presented  in  Section  3  of  this  report  will  be  needed 
for  these  designated  units. 

Also,  there  are  several  other  operational  variables, 
in  addition  to  "mean  time  between  failure"  that  can  serve  as 
auxiliary  factors  that  serve  to  link  the  SRU  rework  activities  to 
operational  reliability.  The  measurements  for  these  parameters 
are  included  in  the  sample  data  base  provided  herein. 

2.5.2  Revised -Data.C.ollecfcion  Strategy 

For  the  pilot  set  of  units  in  Table  1,  the  current 
strategy  is  to  acquire  time  samples  of  manufacturers'  test  and 
rework  data  that  relate  to  and/or  influence  the  reliability  of 
these  units  during  the  production  and  operational  stages. 
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To  complement  this  strategy,  there  is  a  need  to 
select  specific  electronic  units  produced  by  a  manufacturer,  and 
then  retrace  the  testing  and  operational  reliability  history  of 
this  unit  across  various  applications  in  the  Air  Force. 

This  latter  requirement  looms  more  significant  in 
view  of  the  observation  that  almost  all  of  the  selected  WUCs  in 
the  pilot  set  rank  high  on  the  list  of  "abort"  generations  for 
the  respective  systems  as  reflected  in  the  DO-56  (B-06)  report, 
suggesting  that  these  items  were  most  likely  picked  on  the  basis 
of  known  negative  effect  on  the  operational  performance  of  the 
associated  systems.  In  general,  the  "avionics"  sub-system  would 
be  expected  to  cause  more  aborts  due  to  its  mission  critical 
nature. 

In  either  case,  to  avoid  a  built-in  bias  in  the  data 
base  for  this  research,  there  is  a  need  to  obtain  a  relatively 
large  sample  of  units  and  then  stratify  this  sample  according  to 
some  key  functional  factors,  such  as  aircraft  application; 
failure  rates  and  intensity;  overall  MTBF  range;  avionics  versus 
non-avionics;  deployment  location;  unit  inventory  age;  its 
involvement  in  ECPs;  involvement  in  QDRs,  or  other  factors  that 
might  affect  the  operational  reliability  of  the  unit.  Another 
useful  stratification  of  units  might  indicate  whether  the  unit  is 
manually  accessed  during  normal  operation,  as  through  a  control 
panel  in  cockpit  avionics.  Such  data  would  provide  a  measure  of 
the  human  interaction  on  failures  of  these  units. 

The  rationale  to  support  two  key  stratifications  of  data 
which  are  of  prime  interest  to  this  research  are  discussed  below. 
The  intent  of  these  stratifications  is  to  capture  data  on  unit 
application,  maintenance  and  manufacturer  influences  that  might 
affect  the  operational  reliability  of  the  unit. 


2. 5. 2.1  influences  of  Aircraf t_Main.tenang& 

There  are  large  "spot"  variations  in  the 
failure  rates  and  subsequent  maintenance  action  taken  for  the 
same  electronic  unit  used  among  different  operational  aircraft, 
or  among  aircraft  of  the  same  series  which  are  deployed  differ¬ 
ently.  This  observation  introduces  the  logistics  and  main- 


tenance  concepts  employed  among  operational  aircraft  as  prime 
influences  on  failures  and  resultant  operational  reliability. 

To  capture  the  effect  of  diverse  maintenance 
influences,  there  is  a  need  to  stratify  unit  maintenance  actions 
by  aircraft,  which  are  reflected  in  specific  categories,  such  as 
"On-Equipment",  "Shop",  etc,  and  also  by  other  codes,  such  as 
"How  Malfunction",  "When  Discovered",  and  "Action  Taken".  This 
stratification  is  expected  to  isolate  the  effects  of  different 
maintenance  actions  and  aircraft  deployments  on  operational 
reliability  of  the  selected  units,  as  well  as  the  "maintenance 
maturity"  of  a  given  aircraft  system. 

A  preliminary  stratification  of  this  type  is 
shown  in  Table  2,  which  gives  a  comparative  display  of  the 
maintenance  actions  for  the  same  unit  used  on  different  aircraft 
which  have  diverse  missions.  Note  that  the  total  number  of 
maintenance  actions  for  the  LRU  (65AA0)  is  not  the  sum  of  the 
maintenance  actions  for  its  associated  SRUs.  This  is  a  quirk  of 
the  DO-56  system,  which  dually  attributes  maintenance  actions 
and/or  failure  counts  to  both  the  SRU  and  the  LRU  for  the  same 
activity.  (In  Table  2  and  for  subsequent  reference,  the  LRU 
designator  always  ends  in  a  "0",  as  65AA0.  All  associated  SRUs 
have  identical  first  four  symbols  but  end  with  an  alphabet,  such 
as  65AAB,  65AAC,  etc). 

2. 5. 2. 2  Stratification  by  Manufacturer/Vendor 

The  above-mentioned  effects  on  unit  reliabili¬ 
ty  due  to  application  supports  the  need  to  further  stratify  the 
operational  data  on  selected  electronic  units  manufactured  by 
several  vendors  that  have  a  common  operational  application.  Such 
information  would  have  keen  relevance  at  the  SRU/PCB  level. 

To  test  the  feasibility  of  this  type  of 
stratification,  stock  numbers  of  each  of  the  LRUs  in  Table  1  and 
the  associated  subassemblies  (such  as  those  shown  in  Table  2) 
used  for  base  repair  of  these  LRUs  were  interlinked  to  manufac¬ 
turers'  part  numbers  through  the  DO-46  system  (Reference  Mr.  Gary 
Drexler,  APLC  257-3926).  The  stock  numbers  of  the  subassemblies 
were  derived  from  the  D0-56B  B-05-WK-M17  Part  III  ("Parts 


MAINTENANCE  ACTIONS  BY  AIRCRAFT  AND  WUC  (65AA0) 
A=ON- EQUIP  ACTIONS;  B=SHOP  ACTIONS;  C=PARTS  REPLACED 
DATA  SOURCE:  DO-56  B-05  REPORT  (ENDING  8203) 
THREE-MONTH  WORK  UNIT  SUMMARY 


Replaced")  printout  which  gives  a  summary  of  maintenance  action 
for  selected  WUCs. 

The  resultant  output  of  the  DO-46  System  iden¬ 
tifies  each  component  by  Federal  Stock  Class  Manufacturers' 
(FSCM)  code  and  noun  (e.g.,  circuit  card  assembly).  Since  the 
input  data  are  grouped  by  aircraft,  the  output  stratification  by 
aircraft  and  unit  manufacturer  ca*i  be  accomplished.  Given  the 
FSCM,  the  identity  of  each  manufacturer  can  be  obtained  from  the 
H-4-1,  2  and  3  handbooks  published  by  the  Defense  Logistics 
Systems  Center  (DLSC) . 

However,  this  stratification  is  a  laborious 
procedure,  since  the  FSC/Stock  Number  for  each  unit  on  the  B-05 
Part  III  report  must  be  manually  keypunched  and  re-entered  into 
the  DO-46  system.  However  this  stratification  also  gives  a 
measure  of  possible  ambiguity  in  tracing  an  item  through  the  AFLC 
data  systems  using  FSC  and  NUN  (national  item  identification 
number)  due  to  multiple  unit  stock  numbers  and  multiple  appli¬ 
cations.  Another  method  to  achieve  similar  results  at  the  LRU 
level  involves  the  use  of  the  AFLC  KO-51  data  system. 

2.5.3  Relating  PCB. Repair  Data  .to..  Specific  LRUs/WUCs 

In  general,  PCB's  are  not  repairable  at  "base"  or 
"field".  These  items  are  normally  repaired  at  the  AFLC  depots 
and/or  contractors  facilities  as  detached  units,  or  more  infre¬ 
quently,  they  are  repaired  as  integral  units  in  higher  assem¬ 
blies  (LRUs)  shipped  from  the  field/base  to  the  depot  as  NRTS 
(not  reparable  this  station). 

This  situation  causes  a  major  problem  in  tracking  the 
failures  of  PCBs  through  the  AFLC  DO-56  data  system  and  subse¬ 
quently  linking  these  failures  to  an  "end  article"  such  as  one  of 
the  pilot  units  (LRUs)  in  Table  1. 

That  is,  since  the  PCBs  are  depot  reparable,  data 
concerning  PCB  repair  will  only  appear  in  the  "Off-Equipment"  D0- 
56"C"  report,  instead  of  the  "On-Equipment",  D0-56"B"  report. 
This  means  that  within  DO-56,  "failure"  data  and  subsequent 
rework  activity  on  a  PCB  are  not  uniquely  traceable  to  the  end 
item  (LRU/WUC)  from  which  the  PCB  was  removed  upon  malfunction  or 
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failure  indications,  since  no  identification  with  an  aircraft  or 
work  unit  code  (WUC)  appears  in  the  D0-56"C"  report. 

This  problem  can  be  partially  resolved  by  concur¬ 
rently  using  both  the  D0-56"B"  and  the  D0-56"C"  reports  for  data 
on  each  of  the  work  units  of  interest.  The  data  on  these  two 
reports  can  be  correlated  to  the  Air  Force  base  (location)  of 
application  for  each  work  unit,  hence  to  each  relevant  aircraft, 
and  then  to  an  LRU  thereon. 

The  methodology  mentioned  in  2. 5. 2. 2  involving  the 
use  of  DO-46  and/or  KO-51  can  be  used  to  further  resolve  this 
problem.  For  example,  in  the  trial  run  mentioned  above,  which 
involved  all  of  the  pilot  LRUs  for  the  three  month  period  ending 
April  30,  1982,  approximately  82%  of  all  parts  replaced  involved 
"circuit  card  assemblies"  or  PCBs.  This  percentage  could  be 
further  stratified  by  aircraft  to  give  manhour  allocation  by  unit 
and  weapon  system  which  is  missing  in  the  direct  use  of  DO-56. 

The  net  effect  of  this  problem  is  to  increase  the 
amount  of  data  processing  and  analysis  needed  in  Phase  I  that 
must  be  continued  into  Phase  II.  This  requirement  places  prime 
emphasis  on  obtaining  the  data  base  for  this  research  in  computer 
readable  format. 

2.5.4  Mfiasu ring. Other  K.ev_  Operational  Parameters 

The  intent  of  this  research  is  to  determine  the 
"degree"  of  correlation  among  unit  reliability,  rework  and  yield, 
and  there  are  several  "intermediate"  variables  that  contribute  to 
this  correlation  that  depend  on  operational  data.  Time  trends  in 
such  measured  parameters  as  (1)  failures  per  maintenance  action; 
(2)  failures  per  unit  inventory;  (3)  manhour  allocation  per  unit 
failure,  in  addition  to  mean  times  between  maintenance  ( MTBM)  and 
failure  (MTBF)  illustrate  some  of  the  primary  measured  variables 
(i.e.,  available  data)  needed  to  link  rework  and  yield  data  to 
operational  reliability  of  the  selected  LRUs  over  time. 

The  data  needed  to  quantify  these  additional 
parameters  are  included  in  the  AFLC  DO-56  B  and  C  reports.  These 
data  are  discussed  in  more  detail  in  Section  3. 
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SECTION  3 

DESCRIPTION  AND  EXPLANATION  OF  DATA 
AND  INFORMATION  COLLECTED  IN  PHASE  I 


3.1  DATA  DESCRIPTION  OVERVIEW 

The  objective  of  this  section  is  to  link  the  key  parameters 
(available  data)  defined  in  Section  2  to  the  primary  transforma¬ 
tions  (computational  methods)  on  these  data  required  to  evolve  a 
relationship  among  operational  reliability  of  selected  units 
(LRUs),  unit  yield  and  the  degree  of  rework  associated  with  the 
shop  replaceable  units  used  to  repair  these  units.  Emphases  are 
placed  on  the  different  interpretations  of  similarly  defined 
parameters  and  the  different  uses  of  the  same  data  by  manufac¬ 
turers  and  the  government. 

The  expressed  intent  of  this  section  is  to  assure  that  the 
outcomes  of  this  research  can  be  replicated  using  different  data. 

3.2  DESCRIPTION  OF  OPERATIONAL  RELIABILITY  DATA 

Due  to  the  extensive  volume  of  operational  data  reviewed  in 
Phase  I,  only  selected  subsets  are  displayed  in  this  section  in 
the  form  of  exhibits  and  graphs  that  illustrate  each  of  the  key 
parameters  defined  herein.  Other  parts  of  the  research  data  base 
are  shown  in  Appendix  V.  Also,  there  are  several  modes  to  display 
these  data,  which  are  the  "time  series"  graphs  where  each  data 
value  is  associated  with  the  time  of  its  occurrence;  frequency 
distribution  mode  where  each  datum  is  detached  from  time,  or  the 
tabular  form  as  used  for  bulk  data  displays  in  the  appendices. 
Also  "exhibits"  are  used  to  depict  data  in  the  format  used  by  the 
source  which  illustrate  the  mode  for  assembling  these  data  and 
how  these  data  are  used  in  actual  operations. 

In  the  sections  below,  descriptions  of  key  parameters  are 
made  in  the  context  of  actual  data  used  for  their  measurement. 

3.2.1  Observations  Concerning  MTBF  and  MTBM 

For  both  operational  data  generated  in  the  Air  Force 
and  test  data  generated  by  manufacturers,  the  primary  computed 
parameters  are  "mean  time  between  failure"  (MTBF)  and  its 
counterpart,  "mean  time  between  maintenance  events"  (MTBM). 


However,  the  definition,  computation  and  interpretation  of  these 
parameters  vary  widely  between  manufacturers'  use  and  operational 
usage  in  the  Air  Force.  These  unresolved  differences  account  for 
a  major  discontinuity  in  the  use  of  unit  test  reliability  data  as 
a  predictor  of  operational  reliability  (see  reference  by  Kerns 
mentioned  in  Section  2.3.1). 

Even  within  the  Air  Force,  there  has  been  a  con¬ 
tinuing  problem  with  the  definition  and  computation  of  both  MTBF 
and  MTBM  from  operational  logistics  data  in  the  Air  Force  Mainte¬ 
nance  Data  System  which  generates  DO-56.  So,  starting  in  January 
1980,  the  term  "MTBF"  was  completely  dropped  from  AFLC  data 
systems  and  replaced  with  MTBM  (Type  1)  to  better  reflect  the 
operational  measurement  actually  being  computed.  MTBM  (Type  1)  is 
denoted  as  "MTBM-1"  and  is  computed  as  follows: 

MTBM-1  =  1AZC  Operating.  Tim e)Xl Use  Factor)  X(OPA)X(Inv  Ratio) 

Quantity  of  Failures  Observed 

a.  "A/C  Operating  Time"  is  a  three  month  accumulation  of 
flying  hours; 

b.  "Use  Factor"  is  the  estimated  ratio  of  the  unit  oper¬ 
ating  time  to  flying  hours.  Therefore,  the  product  (Use  Factor) 
X  (A/C  Operating  Time)  is  an  estimate  of  the  "Unit  Operating 
Time"; 

c.  "QPA"  denotes  Quantity  per  Application  and  is  the  number 
of  identical  items  reported  under  the  same  work  unit  code  (WUC); 

d.  "Inv(entory)  Ratio"  is  typically  1.0; 

e.  "Quantity  of  Failures"  is  a  three-month  accumulation  of 
failures  (as  defined  by  selected  maintenance  codes.  See  Appendix 
IV)  . 

The  universal  definition  used  to  compute  the  "mean 
time  between  failure"  (MTBF)  is: 


MTBF  =  _ Unit  Operating  Time 

Quantity  of  Failures  Observed 

When  QPA  =  Inv  Ratio  =  1,  then  MTBM-1  =  MTBF,  but  only  to  the 
degree  that  the  expression  (Use  Factor)  X  (A/C  Operating  Time)  is 
an  accurate  estimate  of  Unit  Operating  Time.  However,  there  are 
major  deviations  of  this  latter  estimate  which  causes  the  wide 


variations  in  the  computation,  interpretation  and  comparison  of 
operational  MTBF  (See  RA DC  Report  TR-76-366). 

In  general,  the  computed  MTBM-1  is  greater  than  or 
equal  to  the  estimated  operational  MTBF  as  computed  from  AFLC  DO- 
56  data.  As  with  the  MTBM-1  described  above,  MTBF  can  be 
computed  for  "spot"  values  of  operating  time  and  failures 
observed  (say,  over  three  months)  or  most  often,  MTBF  is  computed 
with  cumulative  values  of  these  data  derived  over  a  long  period 
of  time. 

In  addition  to  MTBM-1,  a  new  variable  called  MTBM- 
Total  was  defined  in  January  1980,  which  is  computed  exactly  as 
MTBM-1  with  the  exception  that  the  "total  number  of  maintenance 
actions"  for  a  given  unit  is  substituted  for  the  "quantity  of 
failures  observed".  Thus  MTBM-Total  always  equals  or  is  less 
than  MTBM-1.  Succinctly  stated,  the  intended  equivalency  of 
terms  are: 


Before  Jan  1980  |  After  Jan  1980 


MTBF - I - >  MTBM-1 

MTBM - | - >  MTBM-Total 


Since  the  Use  Factor  and  Inv  Ratio  for  all  the  pilot 
items  in  Table  1  are  set  to  1.0  (in  the  D056  B-06  Report),  the 
primary  distinguishing  feature  between  the  D0-56  computed  MTBM 
(Tot)  and  MTBM-1  for  these  selected  items  is  (or  should  be)  the 
QPA,  which  suggests  that  time  plots  of  the  MTBM  (Tot)  and  MTBM-1 
will  be  highly  correlated  over  time  (which  is  actually  the  case 
with  the  data  shown  herein). 

It  should  be  specifically  noted  that  the  AFLC  DO-56 
system  does  not  directly  support  the  computation  of  operational 
"MTBF"  that  is  equivalent  to  the  computation  used  by  manufac¬ 
turers  in  the  testing  of  units,  since  there  is  no  measurement  of 
the  actual  operating  time  of  the  specific  unit  and  "failures"  are 
defined  differently.  Moreover,  it  is  estimated  that  about  20%  of 
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all  unit  failures  can  be  attributed  to  non-operating  causes  (RADC 
Report  TR  80-136),  which  if  true,  would  tend  cause  a  major  dis¬ 
tortion  in  the  MTBF  unit  on  the  basis  of  "unit  operating  time". 

But  it  has  been  observed  that  the  DO-56  computed 
value  of  "operational"  MTBF  and/or  MTBM-1  is  roughly  equivalent 
to  one-half  of  the  manufacturer's  computed  value  of  "test  MTBF" 
for  a  given  unit  (See  Figure  4,  paragraph  3.2.4  and  also  RADC 
Report  TR-76-366) . 

3.2.2  Analysis  of -MTBF/MTBM  and  MTBM-1/ MTBMr Total  Trends 

A  time  series  plot  of  the  DO-56  computed  MTBF  (i.e., 
MTBM-1)  for  the  LRU  65AA0  on  the  A10  (Figure  1)  illustrates  some 
of  the  most  common  features  of  similar  plots  for  all  of  the  other 
units,  which  are  the  widely  varying  cyclical  patterns  in  all  of 
these  graphs.  Also,  nearly  all  of  the  similar  graphs  for  the 
selected  units  show  increasing  trends  in  the  MTBM-1  time  graphs 
after  the  change  in  definition  of  MTBF/M  occurred  in  January 
1980.  Of  significance  for  the  item  shown  is  the  continual  and 
steady  decrease  in  the  computed  operational  values  of  MTBM-1, 
which  might  suggest  that  this  item  is  "wearing  out." 

Quite  possibly,  the  cyclic  trends  (from  6  to  8  months 
in  length)  in  the  MTBF/MTBM  graphs  are  caused  by  the  process  used 
in  DO-56  to  compute  MTBF  and  MTBM-1  which  is  the  accumulation  of 
data  in  three  month  intervals.  In  effect,  the  computation  of  the 
variables  are  "restarted"  every  three  months.  There  are  also 
large  variations  within  each  cycle,  which  could  be  a  function  of 
the  procedure  for  collecting  the  AFM  66-1  data  which  causes 
"batching"  of  inputs  into  DO-56  computation  system. 

Without  question,  a  longer  smoothing  (averaging) 
method  with  a  time  interval  for  data  accumulation  exceeding  three 
months  is  needed  for  the  MTBF/M  computations,  since  the  average 
variation  in  computed  MTBF/M  over  a  three-month  period  can  exceed 
300%.  Such  large  variations  account  for  the  low  credibility  and 
continual  misinterpretation  of  these  computed  variables  for 
predictive  or  comparative  purposes. 
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Figure  I 

COMPUTED  MTBF/MTBM- 1  (WUC  65AAO,  A-lOA) 
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There  also  appears  to  be  influences  in  the  MTBF/M 
computations  due  to  changes  in  the  inventory  of  the  unit  (or 
system  inventory,  as  reflected  on  the  DO-56  B-05  report).  Spot 
decreases  in  inventory  normally  reflect  increases  in  unit  condem¬ 
nations  that  in  turn  may  affect  the  quantity  of  future  procure¬ 
ments  or  influence  reparable  generation  rates.  But  condemnations 
may  be  less  frequent  for  the  modular  units  in  Table  1.  Possibly, 
the  computational  methodology  of  DO-56  may  affect  this  influence 
since  newly  procured  units  coming  into  the  inventory  may  negate 
immediacy  for  reparable  generations,  which  would  cause  distor¬ 
tions  in  the  computed  MTBM  time  graph. 


The  suspected  relationship  of  unit  yield,  rework 
activity  and  operational  reliability  is  affected  by  the  aircraft 
system,  its  place  of  deployment  and  maintenance  concepts.  For 
example,  Teledyne,  who  makes  the  APX-101  IFF  transponder  receiver 
concurrently  used  on  the  A10,  F15,  and  F16,  states  that  their 
data  show  a  remarkably  wide  disparity  of  unit  "failures"  among 
these  three  aircraft  (Reference:  Mr.  Leighty,  Teledyne,  Newbury 
Park,  Calif  Office). 

The  diverse  missions  of  these  aircraft  are  suggested 
as  the  cause  of  these  differences.  There  are  known  differences 
in  failure  rates  of  the  APX-101  used  on  the  F-16  deployed  in 
Germany  (where  the  IFF  is  routinely  used)  versus  the  failure  rate 
for  F-16s  employed  stateside  (where  the  IFF  is  rarely  used  and/or 
its  use  is  not  mission-critical). 

These  mission  influences  can  be  illustrated  through 
the  composite  plots  of  the  calculated  MTBM-1  for  the  APX  101  (WUC 
65AA0)  for  each  of  the  three  aircraft  over  the  same  time  period 
as  shown  in  Figures  2.  In  this  plot,  however,  it  is  noticed  that 
the  linear  trend  of  the  MTBM-1  plots  for  each  of  the  three  air¬ 
craft  is  similar,  although  the  spot  variations  among  these  graphs 
vary  widely. 

A  similar  plot  showing  MTBM-Total  for  the  same  air¬ 
craft  and  WUC  is  presented  in  Figure  3.  The  trend  in  both  MTBM-1 
and  MTBM  Total-plot  are  highly  correlated  as  expected. 


Figure  2 

COMPUTEO  MTBF/MTBM-I  (WUC-65AAO) 
( F  — 150;  F-I6A;  F-I6B) 
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Figure  3 

COMPUTED  MTBM-Tol  (WUC  65AA0) 
(F-I5C;  F-I6A;  F-168) 
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3.2.4  Comparison  of  Test  and  Operational  Values  of  .MTBF 

The  composite  plots  of  MTBM-1  (which  is  proportional 
to  MTBF)  in  Figure  2  suggest  a  possible  method  in  which  the 
"trend"  of  operational  MTBF  can  be  compared  to  "trend"  of  the 
MTBF  computed  from  test  lots  of  the  same  unit  during  the  same 
period.  This  comparison  directly  impacts  the  objective  of  this 
research. 

First,  as  noted,  only  the  MTBM-1  computations  for  the 
newer  model  aircraft,  F-15  and  F-16,  are  included,  to  support  the 
premise  that  the  newly-tested  units  (Teledyne  WUC  65AA0)  may  be 
more  relevant  to  the  future  inventory  of  these  aircraft  than  to 
the  older  F-4  and  A-10. 

In  Figure  4,  a  Computed  MTBM-1  Average  for  the  air¬ 
craft  shown  is  graphed  as  indicated.  This  trend  line  corresponds 
to  the  mathematical  operation  of  averaging  or  smoothing  the  data 
shown  in  Figure  2. 

The  crosshatched  area  in  Figure  4  shows  the  trend  of 
test  data  from  Teledyne:  the  solid  plot  in  the  crosshatched  area 
is  the  computed  MTBF  from  Teledyne  (see  Appendix  II). 

As  illustrated  in  Figure  4,  the  slopes  (linear  trend) 
of  the  Computed  MTBM-1  Average  and  the  cumulative  test  MTBF 
values  from  Teledyne  (solid  line  in  crosshatched  area)  are  nearly 
identical,  although  the  numerical  values  of  these  curves  differ 
widely  for  a  given  time  period.  This  means  that  the  time  trend 
of  the  test  and  operational  values  of  MTBM-1  are  nearly  equal  and 
that  the  resultant  equations  for  these  lines  differ  by  a  constant 
value.  Thus  either  variable  could  be  used  as  a  predictor  of  the 
other . 

However,  from  the  RADC  Report  76-366,  it  is  stated 
that  the  test  MTBF  and  the  computed  operational  MTBF  typically 
differ  by  a  factor  of  two.  This  premise  is  represented  graphi¬ 
cally  by  the  line  labelled  "MTBF  Estimate"  in  Figure  4.  This 
line  should  approximate  the  Teledyne  MTBF  Estimates.  In  Figure 
4,  wide  variations  exist  between  these  two  estimates,  although 
these  estimates  tend  to  converge  as  time  increases. 

Is  it  possible  that  this  factor  mentioned  in  the  RADC 

33 


Figure  4 

VERSUS  OPERATIONAL  MTBM  -  I  TREND 


YEAR  &  MONTH 


report  may  actually  vary  with  time?  To  examine, this  premise, 
the  ratio  of  the  ordinate  values  of  the  line  labelled  "Computed 
MTBM-1  Averages"  and  the  cumulative  MTBF  test  values  (solid  curve 
in  crosshatched  area)  is  computed  and  plotted  as  a  function  of 
time  in  Figure  5.  For  these  data,  the  resultant  computed  ratios 
range  from  four  to  slightly  less  than  two  over  the  time  periods 
shown.  The  plotted  curve  in  Figure  5  suggests  that  this  ratio 
tends  to  stabilize  as  time  increases. 

The  ratio  plotted  in  Figure  5  is  analogous  to  the  K3 
factor  used  to  convert  unit  "unit  test  operating  time"  to  "flight 
hour  equivalents"  in  the  test  data  from  ASD/TA  (see  Exhibit  1). 
Also  this  factor  tends  to  be  equivalent  to  the  "Use  Factor" 
described  in  paragraph  3.2.1.  The  typical  range  for  this  factor 
(as  currently  used)  is  about  1.5  to  2.7. 

In  further  support  of  the  above  analysis.  Exhibit  1 
shows  a  plot  of  the  composite  operational  MTBF  of  the  avionic 
subsystem  for  the  F-15,  which  encompasses  each  of  the  related 
units  listed  for  the  F-15C  in  Table  1.  The  key  observation  in 
this  exhibit  is  that  the  average  operational  (computed)  MTBF  for 

the  subsystem  since  1976  is  about  half  of  the  predicted  MTBF  (Oo 
=  9.7  hours).  That  is,  the  ratio  of  predicted  to  operational 
MTBF  is  a  factor  of  two  for  the  entire  subsystem.  The  absence  of 
a  time-trend  in  this  plot  (since  1976)  suggests  that  a  constant 
value  of  two  for  this  ratio  might  be  applicable,  as  is  repre¬ 
sented  schematically  by  the  constant  (no  trend)  line  in  Figure  5. 

These  results  are  tentative  and  cannot  be  generalized 
from  this  single  example.  They  suggest  a  possible  methodology, 
using  factor  and  trend  comparisons,  could  be  devised  to  relate 
computed  MTBM-1  (operational  MTBF  estimate)  to  the  test  values  of 
MTBF  computed  by  unit  manufacturers  over  the  same  time  periods. 

However  the  foregoing  analyses  do  not  depict  the 
cause  and  effect  relationship  of  test  MTBF  to  operational  MTBF  in 
future  periods.  The  detection  of  such  effects  require  more 
elaborate  time  series  analysis  methods  to  be  employed  in  Phase  II 
of  this  research. 


Figure  5 
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3.3  MANUFACTURERS'  UNIT  YIELD/RELIABILITY  DATA 
3.3.1  Type  ..of  Yi.eld_Data  Available 

Exhibit  2  shows  time-sequenced  data  that  are  uniquely 
appropriate  to  the  primary  objective  of  this  research.  Estimates 
of  unit  yield  are  computed  for  LRU  65AA0  on  the  basis  of  the 
number  of  units  passing  a  preset  number  of  failure-free  (ff)  test 
hours  (here  tff  =  55  hours),  which  is  usually  set  at  about  10%  of 
the  specified  MTBF  in  accordance  with  MIL  STD  781C. 

The  "cumulative  first  pass  yield"  is  computed  by 
dividing  the  cumulative  number  of  test  unit  failures  by  the 
cumulative  number  of  units  tested.  This  yield  value  is  then  used 
to  estimate  the  operational  MTBF,  labelled  for  the 
selected  unit  using  the  exponential  reliability  model. 

The  "cumulative  second  pass  yield"  is  derived  by 
dividing  the  cumulative  number  of  units  with  only  one  failure  by 
the  cumulative  number  of  units  having  one  or  more  failures 
(difference  between  units  number  tested  and  the  number  of  units 
surviving  without  failures). 

Of  key  significance  in  Exhibit  2  is  the  wide  dispari¬ 
ty  between  the  value  of  the  unit  test  operating  hours  (tff  =  55 
operating  hours)  and  the  predicted  MTBF  for  the  item  (0Q  =  1500 
hours).  However  this  criteria  conforms  to  Mil  STD  781C,  which 
prorates  the  maximum  acceptable  failure  rate  over  each  delivered 
lot  of  units. 

Note  also  the  high  stability  of  the  computed  values 
of  first  pass  yield  over  the  entire  time  period.  This  stability 
is  in  direct  contrast  to  the  wide  variability  of  the  MTBM-1 
(Figure  1)  estimates  .for  the  same  unit  over  the  same  (and  subse¬ 
quent)  time  periods. 

Exhibit  3  shows  a  typical  test  summary  sheet  for  nine 
(9)  production  lots  of  the  63BXX  subsystem,  consisting  of  three 
test  items  per  lot.  The  "desired"  or  predicted  MTBF  is  0o  =  980 
hours;  the  total  test  test  time  to  failure  is  provided,  and  point 
estimates  of  the  (laboratory)  MTBF  are  computed. 

The  key  feature  of  the  test  report  in  Exhibit  3  is 
the  category  labelled  "Rel  Fail"  or  Related  Failures,  since 
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certain  unit  failures  may  be  excluded  from  the  computations  by 
the  manufacturer.  It  is  this  "failure  count  exclusion"  issue 
that  tends  to  undermine  the  credibility  in  "first  pass  yield" 
computation  from  the  data  provided  by  the  manufacturer.  At  the 
most,  this  computation  represents  a  "best  case"  estimate  from  the 
data  provided.  AEPRT  (All  Equipment  Production  Reliability 
Testing)  was  designed  specifically  to  counteract  this  problem. 

Also  in  Exhibit  3,  the  actual  values  of  the  test  time 
for  each  item  would  be  much  more  useful  data  than  the  aggregate 
values  when  the  size  of  the  test  sample  is  so  small.  The  most 
useful  data  would  be  the  actual  failure  times  for  each  of  the 
item  failures,  regardless  of  cause  (i.e.,  "related"  and  "unre¬ 
lated"  failures). 

Exhibit  4  shows  an  actual  "spot"  sample  of  manufac¬ 
turer-derived  test  and  reliability  data  for  several  of  the 
relevant  units  in  Table  1  related  to  the  F-15.  These  "typical" 
data  were  also  provided  by  ASD/TA,  and  show  some  of  the  Work 
Unit  Codes  that  extend  below  the  subsystem  level,  which  are 
51EA0,  65AA0,  65BH0  listed  in  Table  1.  Other  system  and  sub¬ 
system  level  codes  for  the  F15  relevant  to  this  research  include 
52XXX,  74JXX  and  74KXX  as  shown  on  this  Exhibit. 

Exhibit  4  is  typical  of  the  pre-selected  sets  of 
units  whose  test  and  production  data  are  tracked  over  time  based 
on  criteria  established  early  in  the  unit  development  phase. 

3.3.2  Disgus.ai.ODu 0-f-Jea.t-fiQceduxes  and  leat-Btajfca 

Although  manufacturers'  functional  testings  are 
witnessed  by  government  personnel,  the  unit  testing  models  and 
the  resultant  test  data  (reviewed  by  the  researchers)  appear 
exceedingly  fragile  and  non-standard.  Accordingly  these  test  data 
are  subject  to  wide  variations  in  interpretations  with  corre¬ 
spondingly  low  credibility. 

For  example,  in  the  unit  test  procedures  reviewed, 
there  are  no  explicit  penalties  associated  with  the  failure  of  a 
test  unit,  since  the  test  is  simply  repeated.  That  is,  the 
primary  objective  (of  the  Air  Force)  is  only  to  obtain  a  certain 
number  of  units  that  passes  a  given  test.  Thus  a  manufacturer 
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EXHIBIT  4 


F-15 

Subsystem 

Reliability 

for  Selected 

Avionics  Items 

Cum 

Cum 

Field 

Op.  Hr. 

Field 

RQT 

Cum.  Lab 

Equipment 

(WUC) 

mfhbf 

Fit.  Hr. 

MTBF 

MTBF 

NTSF 

MTB 

1) 

EAIC 

(UPDO) 

503 

2.4 

1207 

1010 

1260 

1000 

2) 

t’DS 

(49AXX) 

1234 

1.5 

1851 

4340 

2558 

1500 

3) 

ADI 

( 51ADO) 

660 

5.7 

3762 

4512 

2414 

1500 

4) 

ADC 

(51EAO) 

480 

2.3 

1104 

809 

6  27 

800 

5) 

HSI 

(51NAO) 

344 

2.5 

860 

909 

413 

680 

6) 

AFCS 

(52XXX) 

157 

2.3 

361 

708 

555 

415 

7) 

SDRS 

(55BXX) 

49 

1.2 

59 

1789 

2522 

570 

8) 

CC 

(57XXX) 

180 

2.4 

432 

1426 

1243 

1000 

9) 

ICNICP  (63BXX) 

82 

4.5 

369 

1218 

1488 

480 

10) 

IFF 

(65AAO) 

227 

2.2 

499 

762 

662 

500 

11) 

IRE 

(65BHO) 

533 

0.9 

480 

722 

— 

700 

12) 

INS 

(71AXX) 

71 

1.5 

106 

— 

— 

200 

13) 

ADF 

(71BXX) 

2865 

0.3 

860 

1434 

2010 

1000 

14) 

ILS 

(7 ICAO) 

1794 

1.0 

1794 

1135 

1184 

1000 

15) 

AHRS 

(71FXX) 

148 

2.3 

340 

933 

603 

750 

16) 

LCG 

(74EBO) 

350 

1.6 

560 

1206 

1193 

1000 

17) 

RADAR 

(74FXX) 

16 

1.5 

24 

38 

58 

60 

18) 

VSD 

(74JXX) 

137 

1.8 

247 

569 

290 

500 

19) 

HUD 

(74KXX) 

67 

1.7 

100 

236 

— 

350 

20) 

ACS 

(75MXX) 

264 

(-) 

396* 

325 

258 

300 

21) 

IBS 

(76CXX) 

1370 

(2.1) 

3927 

1060 

2054 

1000 

22) 

TEWS, 

23) 

(ICC, 

RWR, 

24) 

EWWS) 

* 

Assumed 

Op  Hr.  to  Fit  Hr. 

ratio  of  1.5 

• 
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producing  a  large  volume  of  units  (as  PCBs)  could  substitute  good 
units  for  failed  ones  and  retain  the  failed  units  for  inclusion 
in  subsequent  lots  following  rework  actions  thereon. 

In  effect,  the  in-depth  analyses  about  "why"  the  unit 
test  failure  occurred  are  missing,  which  explains  the  absence  of 
test  data  on  unit  failures  during  test  below  the  LRU  level. 

3.4  DATA  ON  UNIT  REWORK 

3.4.1  Rework  at  the  LRU  Level 

In  all-modular  LRUs  such  as  WUC  65AA0,  one  would 
expecc  very  high  fault/failure  isolation  to  the  PCB  (SRU)  level, 
so  that  almost  100%  of  the  base  level  "on  equipment"  repair 
actions  should  involve  PCB  replacements,  with  very  few  LRUs  being 
NRTSed  to  the  depot.  Thus  concurrent  increases  in  item  failures 
per  unit  inventory,  number  of  NRTS  and  associated  "unscheduled" 
manhours  at  base  level  should  reflect  changes  in  unit  rework 
activity. 

From  the  available  data  in  the  AFLC  DO-56  system,  a 
simple  measure  of  rework  volume  may  be  the  computed  "failures  per 
unscheduled  manhour",  or  its  inverse,  "unscheduled  manhours  per 
failure".  A  composite  plot  of  these  computations  is  shown  in 
Figure  6  for  different  aircraft  applications  of  the  same  unit  WUC 
513A0 . 

In  each  case  shown,  the  trend  is  towards  increased 
manhours  allocation  per  failure  for  each  of  the  applications  of 
this  WUC/LRU.  This  rework  might  reflect  the  absence  of  the 
"maintenance  learning  curve"  for  the  unit  or  the  increasing 
fragility  of  the  unit  due  to  past  rework  actions  (or  possibly 
other  factors). 

Another  potential  measure  of  rework  activity  at  the 
LRU  level  might  be  derived  from  the  equations  for  MTBM  (Tot)  and 
MTBM-1.  The  reciprocal  of  each  of  these  parameters  is  inter¬ 
preted  as  a  "rate"  of  occurrence  of  maintenance  and  failure 
events  respectively.  Thus  the  difference  in  the  reciprocal  of 
these  two  parameters  can  be  interpreted  as  the  rate  of  change  in 
effectiveness  of  failure  isolation  and  detection  at  the  LRU 
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level.  This  difference  is  expressable  as  a  rate: 

Il/MTBM-Totall  -  tl/MTBM-13  =  tMaintenance  Actions  -  ^Failures. 

K (Operating  Time) 

where  K  =  (Use  Factor)X (QPA)X (Inventory  Ratio)  and  is  typically 
equal  to  unity  for  the  pilot  units  in  Table  1. 

From  this  formula,  if  the  number  of  failures  and 
maintenance  actions  are  on  a  1:1  basis  (implying  effective  LRU 
fault  diagnosis),  this  difference  is  zero.  Conversely,  as  the 
number  of  maintenance  actions  exceeds  the  number  of  failures 
discovered  (implying  less  effective  fault  diagnosis  and/or  rework 
increases),  this  difference  increases  accordingly.  Thus  it  may  be 
possible  to  link  unit  (LRU)  rework  activity  directly  to  the 
computed  operational  parameters,  MTBM-1  and  MTBM-Total.  Further 
development  of  this  premise  is  scheduled  in  Phase  II. 

3.4.2  Rework at  the  SRU/PCB  Level 

As  stated  previously,  there  are  no  direct  data 
linkages  in  the  Air  Force  Maintenance  Data  System  (DO-56)  between 
the  rework  (manhour)  data  for  an  SRU/PCB  and  the  specific  unit  or 
SRU  from  which  the  failed  PCB  is  taken.  But  this  problem  may  be 
partially  resolved  by  data  processing  outside  of  the  DO-56  system 
using  the  AFLC  DO-46  and  KO-51  data  systems. 

Nevertheless  this  linkage,  or  the  absence  thereof, 
requires  further  explanation  for  two  major  reasons.  First,  data 
on  rework  actions  on  PCBs  by  the  manufacturer  during  reliability 
qualification  testing  (RQT)  and/or  production  reliability  testing 
(PRT)  cannot  be  sufficiently  distinguished  in  the  resultant  test 
reports.  That  is,  there  is  no  current  requirement  for  these 
details  to  be  included  in  the  test  data  reports.  Only  during 
post-production  test  period  is  there  isolation  of  data  for  unit 
failures  at  the  SRU  level,  but  these  data  are  not  currently 
required  in  the  test  reports;  only  "related  failures"  at  the  unit 
or  LRU  level  are  reported. 

Second,  it  is  noted  that  repair  and  rework  actions  on 
PCBs  at  the  depots  are  a  result  of  prior  operational  SRU 
failures,  since  for  the  highly-modular  units  as  in  Table  1,  more 
than  80%  of  all  failure  are  attributable  to  circuit  card 
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assemblies,  which  includes  PCBs.  In  effect,  there  is  a  well- 
known  and  direct  cause  and  effect  relationship  between  PCB  repair 
and  unit  failure  due  to  the  modular  design  of  the  unit.  Also 
according  to  ASD/PRAM  and  DESC,  PCB  "failures"  are  most  often 
credited  to  electrical  connections  on  the  board  structure  itself, 
as  opposed  to  the  failure  of  discrete  units  thereon.  In  this 
case,  "rework"  of  the  PCB  is  typically  infeasible  as  a  repair 
action. 

Thus,  as  a  tentative  premise,  it  seems  that  repair 
and  rework  activities  at  the  SRU/PCB  level  may  tend  only  to 
reflect  the  consequence  of  past  unit  failures  rather  than  be  a 
predictor  of  future  operational  reliability  of  the  associated 
LRU,  since  specific  reliability  problems  at  this  level  are  con¬ 
tinually  assessed  and  subjected  to  "fixes"  (as  is  the  function  of 
ASD/PRAM).  If  such  problems  are  undetected,  or  otherwise  masked 
and  reliability  improvements  do  not  occur,  data  on  PCB  repair  and 
rework  actions  would  possess  a  greater  predictive  capability  for 
subsequent  LRU  reliability. 

The  net  effect  of  this  situation  is  that  the  typical 
unit  development  and  evolution  tends  to  "decouple"  the  direct 
influence  of  PCB  repair  and  rework  from  the  operational  relia¬ 
bility  of  the  associated  LRU.  However,  these  effects  are 
believed  to  be  translated  to  other  intermediate  variables  as 
discussed  herein.  This  premise  is  tentative  and  will  be  further 
analyzed  in  the  expanded  data  analyses  to  continue  in  Phase  II. 

3.5  OTHER  SUPPORTING  DATA  (UNIT  FAILURE  DISTRIBUTIONS) 

Compilation  of  the  extensive  sets  of  data  for  each  of  the 
selected  units  is  an  excellent  opportunity  to  develop  statistical 
distributions  for  such  parameters  as  failures  per  unit  period,  as 
illustrated  in  Figure  7.  Data  in  this  form  could  greatly  augment 
the  generalizations  from  this  research  if  these  distributions  are 
well-defined  and  relatively  stable  (that  is,  the  average  number 
of  events  per  randomly-chosen  period  is  relative  constant. 

Unfortunately,  such  variables  as  the  number  of  unit  failures 
per  time  period  depend  on  both  flight  activity  and  unit  inven- 


f 


1 


tories  which  vary  widely  over  time  and  are  highly  unstable  due 
mainly  to  continual  logistics  influences  that  seek  to  decrease 
the  failures  for  an  unit.  For  example.  Figure  7  shows  the  dis¬ 
tribution  of  unit  failures  per  month  for  WUC  513A0  over  the  time 
period  indicated.  The  mean  of  this  distribution  continually 
shifts  to  the  left,  implying  fewer  failures  per  month  are  occur¬ 
ring  as  time  passes. 

The  distribution  in  Figure  8  gives  the  failure  distributions 
of  WUC  513H0  (F-4)  over  two  contigious  time  segments.  The  mean 
of  these  distributions  has  decreased  drastically,  again  indi¬ 
cating  fewer  failures  per  period  as  time  progresses. 

For  these  same  data,  an  alternative  form  for  display  is  the 
time  series  mode  as  shown  in  Figure  9  for  WUC  513U0  (F-4).  The 
well-defined  linear  time  trend  of  these  data  causes  the  insta¬ 
bility  in  the  mean  of  the  frequency  distributions  discussed 
above. 

However  when  the  linear  trend  in  Figure  9  is  removed,  a 
stable  "normal"  distribution  results  from  the  difference  (resi¬ 
duals)  in  the  trend  line  and  the  actual  values  as  shown  in  Figure 
10.  This  resultant  distribution  tends  to  be  highly  stable  for 
each  set  of  the  above  data,  which  suggests  that  "first  order" 
time  series  methods  may  be  much  more  powerful  techniques  for 
analysis  of  these  data  than  the  typically-used  frequency  distri¬ 
butions.  Both  time  series  and  distributional  data  will  be  used 
in  the  analyses  in  Phase  II  as  needed. 
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Figure  10 

DEVIATION  OF  ACTUAL  PLOT  FROM  TREND  VALUES 
(from  Figure  9) 


DEVIATION  FROM  TREND  LINF 
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ELECTRONICS 

6*3  lAWREnCS  OPivE 
NcV»BuBv  =*B»  =CBNIA  3’  22C 
605,  *36-362-  "A'i  S' 2  236- '252 

22  November  1982 


Or.  Eugene  Jones 
K.  L.  364  E 
University  of  Dayton 
Dayton,  Ohio  45469 

Dear  Dr.  Jones, 

It  was  a  pleasure  to  talk  with  you  about  Teledyne's  RT-1Q63C/APX-101 
Transponder.  I've  taken  far  too  long  in  gathering  some  data  for  you  -  I  apologize 
for  the  delay.  I  am  sending  along  a  portion  of  a  recent  proposal  which  descri¬ 
bes  our  transponder,  the  maintenance  concept  (recently  revised),  and  con¬ 
figuration  and  quality  control.  Some  of  the  additional  data,  such  as  the  list 
of  final  reports,  may  also  be  of  interest. 

I  am  also  sending  a  copy  of  our  PRT  Log.  As  you  can  see,  it  is  a  com¬ 
pilation  of  4 l/fc  years  of  data  with  over  26,000  hours  of  accumulated  testing.  Let 
me  summarize  our  experience  in  reliability  testing. 

The  AN./APX-101  Transponder  has  undergone  several  formal  demonstration  tests 
where  equipment  time  and  relevant  failures  were  carefully  monitored.  The 
results  of  these  tests  (F-15  Category  I,  F-15  Category  II  and  Production 
Reliability  Tests)  are  given  in  the  following  paragraphs.  These  tests  con¬ 
sistently  show  a  demonstrated  MTBF  greater  than  1200  hrs. 

The  F-15  Category  I  Flight  Test  Program  resulted  in  three  (3)  relevant 
failures  in  3767  operating  hours  for  the  AN/APX-101.  This  equates  to  a 
demonstrated  MTBF  of  1256  hours.  Source:  "F-15  Reliability  Demonstration 
Report  for  Category  I  Flight  Test  Program"  MCAIR  Report  MDC  A3536,  dated 
10  December  1975. 

The  F-15  Category  II  Flight  Test  Program  resulted  in  two  (2)  relevant 
failures  in  2466  operating  hours.  This  equates  to  a  demonstrated  MTBF  of 
1233  hours.  Source:  "F/TF-15  AFDT&E  Reliability  and  maintainability 
Evaluation"  Air  Force  Report  FTC-TR-76-2,  dated  February  1976. 

To  date  eighteen  Production  Reliability  Tests  have  been  conducted  at 
Teledyne  in  accordance  with  USAF  contracts.  All  tests  have  been  conducted 
with  government  witnessing.  Currently  all  Test  Reports  are  reviewed  and 
approved  by  ASD.  To  date,  the  AN/APX-101  has  accumulated  19  relevant 
failures  in  26,038  operating  hours.  This  equates  to  a  demonstrated  MTBF 
of  1370  hours. 

With  respect  to  field  MTBF,  Air  Force  AFM  66-1  D056  reports  for  the  A-iO 
Aircraft  have  consistently  shown  a  field  MTBF  in  flight  hours  of  between 
400  and  500  hours  for  the  APX-101.  In  accordance  with  RADC  Report  No. 
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RADC-TR-75-366 ,  an  average  factor  of  two  should  be  used  to  convert  from 
flight  hours  to  operating  hours.  Therefore,  the  AN/APX-101  field  MT3F  in 
operating  hours  for  the  A-10  aircraft  is  between  30C  to  1000  hours. 

In  summary,  the  AN/APX-101  demonstrated  MT3F  based  on  'JSAF  documents,  or 
USAF  approved  documents,  exceeds  1200  hours;  the  field  MTBF  for  the  A10 
Aircraft  is  between  400-500  hours  in  flight  hours  and  between  300-1300 
hours  in  operational  hours.  Since  it  is  general  knowledge  that  many  IFF 
system  failures  are  currently  being  mistakenly  attributed  to  the 
transponder  one  can  easily  assume  an  MTBF  greater  than  that  reported  in  the 
D056  data. 

In  addition  to  the  above,  the  Air  Force  has  recently  completed  CERT  tests 
on  the  AN/APX-101  using  the  A-10  profile  for  testing  parameters.  These 
tests  resulted  in  an  MTBF  in  excess  of  1000  hours.  Source:  Flight 
Dynamics  Lab.,  Wright  Patterson  AF3. 

The  Production  Reliability  Test  (PRT)  for  the  AN/APX-101  is  conducted  in 
accordance  with  MIL-STD-781B ,  Test  Plan  III,  Test  Level  F.  This  test 
includes  simultaneous  vibration  cycling,  voltage  cycling,  on-off  cycling 
and  temperature  cycling  between  -54°C  and  -‘-7 1  °C -  The  objective  of  the  test 
is  to  verify  continued  compliance  with  the  specified  mean-time-between- 
fai lures  (MTBF).  The  PRT  is  performed  on  at  least  four  samples  out  of  each 
production  lot  (minimum  of  16  units  per  year).  The  accept/reject  criteria 
is  based  on  the  accept/reject  criteria  of  MIL-STD-781B ,  using  a  specified 
MTBF  of  500  hours.  Eleven  hundred  failure  free  hours  indicate  an  accept  on 
the  four  APX-101's.  With  one  failure,  an  additional  345  hours  of  operation 
is  required.  Only  transponder  "ON"  time  is  applicable  for  determining  the 
accept/reject.  (See  the  attachment  for  a  description  of  the  test  profile.) 

All  production  APX-101's  are  subjected  to  a  72  hour  burn-in  consisting  of 
eight  nine-hour  cycles.  The  burn-in  cycle  is  identical  to  the  PRT  cycle. 
During  the  72  hours  of  burn-in,  the  APX-101  BIT  is  being  automatically 
monitored  and,  if  a  failure  occurs,  the  APX-101  is  removed,  repaired  and 
returned  for  additional  burn-in. 

I  hope  these  data  will  provide  you  a  starting  point  for  your  investigation. 
At  Teledyne,  we  feel  there  still  exists  problems  in  U.S.A.F.  intermediate  level 
maintenance  of  the  APX-101.  I  would  like  to  discuss  this  with  you  along  with 
other  experience  on  the  program.  So  far,  I  have  no  plans  to  make  a  trip  east  in 
the  near  future.  However,  if  something  comes  up  I'll  be  sure  to  pass  through 
Dayton.  On  the  other  hand,  should  you  happen  to  be  in  the  Los  Angeles  area, 
please  let  me  know.  If  you  have  any  trouble  reaching  me,  feel  free  to  contact 
Mr.  Ed  Lawson  in  my  stead. 


Very  truly  yours, 

Jim  Leighty,  Manager 
Intergrated  Logistics  Support 
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APPENDIX  II 

Samples  of  Operational 
Test  Data  for  Selected 
Units 

51EA0 

74JXX 


t  3 


AEPRT  -  ADC 


I 

tff  ®  61  hours 


Cum. 


Month 

No.  of 
LAUS 

Envir 

Cycles 

ATP 

No.  of 
Failures 

Mar 

■78 

5 

0 

0 

(0) 

Apr 

'78 

7  • 

2 

1 

(3) 

May 

■78 

17 

2 

1 

(6) 

Jun 

'78 

8 

3 

2 

(11) 

Jul 

'78 

8 

0 

2 

(13) 

Aug 

'78 

17 

1 

5 

(19) 

Sep 

•78 

10 

0 

0 

(19) 

Oct 

•78 

10 

2 

1 

(22) 

Nov 

'78 

5 

0 

0 

(22) 

Dec 

'78 

5 

1 

0 

(23) 

Jan 

•79 

8 

0 

2 

(25) 

Feb 

•79 

9 

0 

1 

(26) 

Mar 

'79 

12 

0 

0 

(26) 

Apr 

'79 

4 

0 

2 

(28) 

May 

'79 

9 

2 

2 

(32) 

Jun 

'79 

6 

3 

1 

(36) 

Jul 

'79 

9 

1 

3 

(40) 

Aug 

•79 

6 

0 

0 

(40) 

Sep 

'79 

3 

0 

0 

(40) 

Oct 

•79 

10 

0 

1 

(41) 

Nov 

•79 

6 

0 

5 

(46) 

Dec 

•79 

5 

0 

0 

(46) 

Jan 

'80 

11 

0 

1 

(47) 

Feb 

•80 

2 

0 

0 

(47) 

Mar 

'80 

7 

0 

0 

(47) 

Apr 

'80 

10 

0 

0 

(47) 

May 

•80 

0 

0 

0 

(47) 

Jun 

'80 

15 

1 

1 

(49) 

Jul 

'80 

6 

0 

0 

(49) 

Aug 

'80 

15 

2 

1 

(52) 

Sep 

'80 

3 

0 

0 

(52) 

Oct 

'80 

4 

0 

0 

(52) 

Nov 

•80 

19 

2 

0 

(54) 

Dec 

•80 

5 

0 

0 

(54) 

Jan 

'81 

8 

1 

0 

(55) 

Feb 

'81 

12 

1 

4 

(60) 

Mar 

'81 

8 

0 

0 

(60) 

Apr 

■81 

12 

1 

1 

(62) 

May 

'81 

15 

1 

0 

(63) 

Jun 

'81 

8 

0 

0 

(63) 

Oq  *  800  hours 
No.  of  No.  of 


OP.  hrs. 
From  ETI 
Reading 

Cum. 

OP.  Hrs. 

Pattern 

Failures 

Identified 

Cum. 

MTBF 

326 

(326) 

0 

326 

565 

(891) 

0 

297 

1346 

(2237) 

0 

373 

942 

(3179) 

1  ? 

289 

682 

(3861) 

2  ? 

247 

1523 

(5384) 

1  ? 

283 

666 

(6050) 

0 

318 

786 

(6836) 

0 

311 

322 

(7158) 

0 

325 

379 

(7537) 

0 

328 

629 

(8166) 

0 

3  27 

614 

(8780) 

0 

338 

720 

(9500) 

0 

365 

389 

(9889) 

0 

353 

884 

(10723) 

0 

335 

671 

(11394) 

0 

316 

1689 

(13083) 

1  ? 

327 

356 

(13439) 

2 

336 

194 

(13633) 

0 

341 

691 

(14324) 

0 

349 

692 

(15016) 

1 

326 

320 

(15336) 

0 

333 

760 

(16096) 

0 

342 

120 

(16216) 

0 

345 

419 

(16635) 

0 

354 

880 

(17515) 

0 

373 

0 

17515 

0 

373 

1050 

18565 

0 

379 

375 

18940 

0 

387 

1106 

20046 

0 

386 

192 

20238 

0 

389 

331 

20569 

0 

396 

1335 

21904 

0 

406 

335 

22239 

0 

412 

563 

22802 

0 

415 

1352 

24154 

0 

403 

497 

24651 

0 

411 

919 

25570 

0 

412 

996 

26566 

0 

422 

495 

27061 

0 

430 

51EAO 


AEPRT  -  ADC 


tff  *  61  hrs.  Oq  »  800  hrs. 


Month 

No.  of 
LRUs 

Envir . 
Cycles 

ATP 

Cum. 

No.  of 
Failures 

No.  of 
OP.  Hrs. 
From  ETI 
Readings 

Cum. 

OP  Hrs. 

No.  of 
Pattern 
Failures 
Identified 

Cum. 

MTBF 

Jul 

•81 

9 

4 

3 

(70) 

1057 

28118 

0 

402 

Aug 

'81 

12 

1 

0 

(71) 

771 

28889 

0 

407 

Sep 

'81 

5 

0 

0 

(71) 

315 

29204 

0 

411 

Oct 

*81 

6 

0 

0 

(71) 

369 

29573 

0 

417 

Nov 

'81 

0 

0 

0 

(71) 

0 

29573 

0 

417 

Dec 

*81 

12 

0 

2 

(73) 

935 

30508 

0 

418 

Jan 

•82 

4 

0 

0 

(73) 

245 

30753 

0 

421 
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VSD  Or  Indicator  Group 


74JXX 


AEPRT  -  VSD  or  IG  (AMNI)  tff  *  41  hrs 


No.  Of  No.  Of 


Month 

NO.  Of 
LRUs 

Envir . 
Cycles 

ATP 

• 

Cum. 

No.  Of 
Failures 

OP  Hrs. 
From  ETI 
Readings 

Cum. 

OP  Hrs. 

Pattern 

Failure 

Identified 

Cum. 

MTBF 

Mar 

'78 

9 

0 

0 

(0) 

442 

(442) 

0 

442 

Apr 

'78 

14 

11 

6 

(17) 

1117 

(1559) 

0 

92 

May 

'78 

12 

7 

1 

(25) 

852 

(2411) 

0 

96 

Jun 

'78 

11 

8 

4 

(37) 

901 

(3312) 

0 

90 

Jul 

'78 

8 

4 

0 

(41) 

644 

(3956) 

0 

96 

Aug 

'78 

17 

11 

2 

(54) 

1115 

(5071) 

0 

94 

Sep 

'78 

12 

10 

2 

(66) 

886 

(5957) 

0 

90 

Oct 

'78 

20 

10 

2 

(78) 

1320 

(7277) 

0 

93 

Nov 

'78 

14 

8 

1 

(87) 

846 

(8123) 

0 

93 

Dec 

'78 

10 

3 

1 

(91) 

520 

(8643) 

0 

95 

Jan 

•79 

10 

2 

0 

(93) 

505 

(9148) 

0 

98 

Feb 

'79 

8 

4 

0 

(97) 

409 

(9557) 

0 

99 

Mar 

'79 

8 

8 

0 

(105) 

512 

(10069) 

1 

96 

Apr 

'79 

10 

11 

2 

(118) 

806 

(10875) 

0 

92 

May 

'79 

9 

3 

0 

(121) 

512 

(11387) 

0 

94 

Jun 

'79 

10 

1 

0 

(122) 

623 

(12010) 

0 

98 

Jul 

•79 

11 

2 

2 

(126) 

657 

(12667) 

0 

101 

Aug 

'79 

10 

5 

2 

(133) 

599 

(13266) 

1  ? 

100 

Sep 

'79 

6 

2 

1 

(136) 

372 

(13638) 

0 

100 

Oct 

'79 

9 

4 

6 

(146) 

763 

(14401) 

0 

99 

Nov 

'79 

10 

3 

1 

(150) 

607 

(15008) 

0 

100 

Dec 

'79 

8 

1 

2 

(153) 

437 

(15445) 

0 

101 

Jan 

'80 

16 

10 

4 

(167) 

1238 

(16683) 

1 

100 

Feb 

'80 

14 

4 

3 

(174) 

841 

(17524) 

0 

101 

Mar 

•80 

18 

4 

2 

(180) 

1030 

(18554) 

0 

103 

Apr 

'80 

8 

1 

0 

(181) 

361 

(18915) 

0 

105 

74JXX 
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r-vzam** 

wk  I 


"Vr 


AEPRT  -  VSD  or  IG  (SDP)  tff  =  44  hrs. 


Month 

No.  of 
LAOS 

Envir 

Cycles 

ATP 

Cum. 

No.  of 
Failures 

No.  of 

OP  Hrs. 
From  ETI 
Readings 

Cum. 

OP  Hrs. 

No.  of 
Pattern 
Failures 
Identified 

Mar 

'78 

13 

3 

0 

(3) 

691 

(691) 

Apr 

'78 

10 

3 

1 

v  7 ) 

632 

(1323) 

May 

•78 

10 

1 

1 

(9) 

850 

(2173) 

Jun 

'78 

11 

4 

0 

(13) 

947 

(3120) 

Jul 

'78 

9 

4 

0 

(17) 

853 

(3973) 

Aug 

•78 

13 

4 

1 

(22) 

769 

(4742) 

Sep 

'78 

9 

2 

2 

(26) 

602 

(5344) 

Oct 

'78 

10 

2 

3 

(31) 

795 

(6139) 

Nov 

'78 

11 

4 

2 

(37) 

691 

(6830) 

Dec 

'78 

4 

0 

2 

(39) 

385 

(7215) 

Jan 

'79 

12 

4 

0 

(43) 

679 

(7894) 

Feb 

'79 

6 

1 

0 

(44) 

261 

(8155) 

Mar 

'79 

8 

0 

0 

(44) 

343 

(8498) 

1 

Apr 

'79 

11 

1 

4 

(49) 

727 

(9225) 

May 

'79 

8 

4 

2 

(55) 

655 

(9880) 

Jun 

'79 

7 

0 

0 

(55) 

302 

(10182) 

Jul 

•79 

3 

0 

0 

(55) 

136 

(10318) 

Aug 

'79 

10 

3 

0 

(58) 

615 

(10933) 

Sep 

'79 

8 

2 

0 

(60) 

335 

(11268) 

Oct 

•79 

9 

0 

2 

(62) 

492 

(11760) 

Nov 

'79 

6 

4 

0 

(66) 

391 

12151 

0 

Dec 

'79 

6 

3 

0 

(69) 

337 

12488 

0 

Jan 

'80 

10 

4 

2 

(75) 

596 

13084 

1 

Feb 

'80 

16 

2 

0 

(77) 

718 

13802 

0 

Mar 

'80 

12 

2 

0 

(79) 

591 

14393 

0 

Apr 

'80 

9 

6 

1 

(86) 

621 

15014 

0 

74JXX 


Cum. 

MTBF 


230 

189 
241 
240 
233 
216 
206 
198 
185 
185 

184 

185 
193 
188 
180 
185 
188 
188 
188 

190 
184 
181 
175 
179 
182 
175 
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AEPRT  -  VSD  or  IG  (AMNI) 


41  hrs 


fcff  _ 


Month 

No.  of 
LRUs 

Envir 

Cycle 

ATP 

Cum. 

No.  of 
Failures 

No.  of 

OP  Hrs. 
From  ETI 
Readings 

Cum. 

OP  Hrs. 

No.  of 
Pattern 
Failures 
Identified 

Cum. 

MTBF 

May 

*80 

10 

1 

2 

(184) 

673 

(19588) 

0 

107 

Jun 

'80 

12 

10 

3 

(197) 

938 

(20526) 

0 

104 

Jul 

'80 

3 

1 

0 

(198) 

164 

(20690) 

0 

105 

Aug 

'80 

9 

8 

0 

(2065 

788 

(21478) 

0 

104 

Sep 

'80 

17 

3 

3 

(212) 

1026 

(22504) 

0 

106 

Oct 

'80 

16 

6 

1 

(219) 

991 

(23495) 

107 

Nov 

'80 

13 

6 

0 

(225) 

763 

(24258) 

108 

Dec 

'80 

17 

4 

3 

(232) 

917 

(25175) 

109 

Jan 

'81 

10 

2 

0 

(234) 

480 

(25655) 

110 

Feb 

'81 

13 

6 

2 

(242) 

983 

(26638) 

110 

Mar 

*81 

11 

3 

3 

(248) 

760 

(27398) 

110 

Apr 

'81 

10 

6 

5 

(259) 

989 

(28385) 

110 

May 

'81 

18 

0 

0 

(259) 

894 

(29279) 

113 

Jun 

'81 

18 

3 

0 

(262) 

927 

(30206) 

115 

Jul 

*81 

17 

2 

2 

(266) 

881 

(31087) 

117 

Aug 

'81 

8 

2 

2 

(270) 

545 

(31632) 

117 

Sep 

•81 

17 

1 

4 

(275) 

915 

(32547) 

118 

Oct 

'81 

6 

6 

3 

(284) 

511 

(33058) 

116 

Nov 

'81 

-* 

/ 

2 

0 

(286) 

375 

(33433) 

117 

Dec 

'81 

4 

0 

0 

(286) 

169 

(33602) 

117 

Jan 

'82 

9 

2 

1 

(289) 

528 

(34180) 

118 

Feb 

'82 

Mar 

'82 

Apr 

'82 

May 

'82 

5 

1 

0 

(  ) 

303 

(  ) 

0 

Jun 

'82 

10 

4 

2 

(  ) 

580 

(  ) 

0 

74JXX 


AEPRT  -  VSD  or  IG  (SDP) 


41  hrs 


i 


fcff  = 


Month 

No.  of 
LRUs 

Envir 

Cycles 

ATP 

Cum. 

No.  of 
Failures 

No.  of 

OP  Hrs. 
From  ETI 
Readings 

Cum. 
of  Hrs. 

No.  of 
Pattern 
Failure 
Identified 

Cum. 

MTBF 

May 

*80 

13 

3 

0 

(89) 

573 

(15587) 

0 

175 

Jun 

'80 

9 

3 

3 

(95) 

582 

(16169) 

0 

170 

Jul 

'80 

2 

1 

1 

(97) 

120 

(16289) 

0 

168 

Aug 

'80 

7 

2 

1 

(100) 

375 

(16664) 

0 

167 

Sep 

'80 

18 

4 

0 

(104) 

823 

(17487) 

0 

168 

Oct 

'80 

21 

2 

0 

(106) 

958 

(18445) 

174 

Nov 

'80 

10 

8 

0 

(114) 

580 

(19025) 

167 

Dec 

'80 

11 

2 

0 

(116) 

518 

(19543) 

168 

Jan 

'81 

7 

5 

2 

(123) 

454 

(19997) 

163 

Feb 

'81 

10 

3 

2 

(128) 

597 

(20594) 

161 

Mar 

'81 

8 

3 

2 

(132) 

490 

(21084) 

160 

Apr 

'81 

6 

0 

0 

(132) 

265 

(21349) 

162 

May 

'81 

5 

1 

0 

(133) 

217 

(21566) 

162 

Jun 

•81 

8 

1 

0 

(134) 

350 

(21916) 

164 

Jul 

'81 

3 

0 

0 

(134) 

166 

(22082) 

165 

Aug 

'81 

3 

0 

0 

(134) 

126 

(22208) 

166 

74JXX 
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Samples  of  Key  AFLC 
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APPENDIX  IV 

Sample  of  Maintenance 
Codes  and  Determination 
of  Component  Failure 
Counts 
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APPENDIX  V 

Sample  Sets  of  Data 
From  AFLC  Data  Systems 
on  Key  Parameters 
Used  in  Research 


AFBRMC  DATA  BASE 
F-4E  DATA  WORK  UNIT  513H0 
DATES  7707-7912 

Text  File:  F4EH0  DSD  File:  F4E513H0 


YR/MO 

OPTIME 

MTBF 

MTBM 

FAIL 

INVEN 

MHRS 

NRTS 

7707 

13826 

17  8 

99 

102 

692 

849 

11 

7708 

15139 

161 

90 

95 

688 

790 

6 

7709 

13968 

145 

80 

100 

6  86 

847 

6 

7710 

10320 

144 

79 

79 

564 

630 

6 

7711 

15208 

152 

86 

81 

659 

602 

6 

7712 

12944 

160 

94 

81 

670 

591 

21 

7801 

13044 

175 

103 

74 

694 

816 

13 

7802 

10624 

153 

88 

84 

676 

766 

5 

7803 

14636 

17  9 

100 

56 

690 

509 

11 

7804 

14530 

172 

99 

92 

682 

818 

7 

7805 

13321 

182 

97 

86 

682 

860 

10 

7806 

14128 

176 

99 

61 

665 

507 

7 

7807 

12302 

177 

99 

78 

628 

646 

12 

7808 

14407 

183 

112 

84 

652 

784 

10 

7809 

12969 

184 

113 

54 

6  46 

585 

10 

7810 

12500 

192 

117 

70 

651 

6  23 

18 

7811 

12632 

193 

123 

73 

654 

563 

9 

7812 

11826 

172 

115 

72 

6  53 

565 

8 

7901 

12667 

17  4 

121 

68 

590 

577 

4 

7902 

11733 

163 

110 

82 

656 

6  85 

5 

7903 

14190 

167 

109 

81 

637 

763 

27 

7904 

13725 

176 

107 

62 

6  07 

633 

15 

7905 

13969 

168 

104 

106 

637 

867 

6 

7906 

13694 

160 

102 

90 

609 

77  8 

9 

7907 

12557 

145 

101 

81 

627 

6  93 

16 

7908 

13962 

161 

111 

79 

57  4 

742 

14 

7909 

11991 

146 

103 

103 

562 

945 

14 

7910 

12869 

164 

112 

54 

538 

419 

5 

7911 

11353 

149 

103 

86 

586 

759 

14 

7912 

9666 

162 

112 

69 

570 

507 

16 

AFBRMC  DATA  BASE 

F4E  DATA  WORK  UNIT  513H0  (CONT'D) 
DATES  8001-8112 

TEXT  FILE:  F4X2  DSD  FILE  F4E51X2 


YR/MO 

OPTIME 

MTBF 

MTBM 

FAIL 

INVEN 

MHRS 

NRTS 

8001 

11140 

151 

103 

58 

594 

574 

8 

8002 

11014 

191 

130 

40 

590 

407 

7 

8003 

11544 

217 

142 

57 

571 
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13 

8004 

11655 

259 

162 

35 

571 

481 

3 

8005 

10740 

225 

141 

59 

525 

53  5 

7 

8006 

11314 

241 

156 

46 

555 

450 

5 

8007 

9259 

197 

136 

49 

555 

453 

3 

8008 

9877 

175 

123 

73 

512 

631 

0 

8009 

9979 

182 

128 

38 

543 

3  81 

6 

8010 

9951 

190 

145 

46 

522 

395 

8 

8011 

7672 

23  0 

15,0. 

36 

54-4 

412 

10 

8012 

9203 

242 

121 

29 

^36 

350 

7 

8101 

8100 

183 

133 

63 

-  517 

675 

7 

8102 

9246 

197 

129 

35 

5  23 

449 

6 

8103 

10711 

196 

163 

45 

490 

53  0 

11 

8104 

9719 

263 

148 

33 

520 

320 

8 

8105 

9452 

241 

132 

46 

495 

424 

7 

8106 

9959 

214 

115 

47 

494 

459 

11 

8107 

10201 

205 

132 

45 

509 

430 

11 

8108 

9885 

191 

130 

59 

513 

512 

8 

8109 

8895 

215 

148 

31 

527 

238 

7 

8110 

9296 

158 

117 

87 

511 

721 

12 

8111 

8799 

164 

118 

46 

498 

441 

4 

8112 

8979 

148 

110 

50 

503 

394 

14 
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AFBRMC  DATA  BASE 
F4D  DATA  WORK  UNIT  513U0 
DATES  7701-7912 
CSD  FILE  F4D513U0 
TXT  FILE  F4D3U0T 


YR/MO 

OPTIME 

MTBF 

MTBM 

FAIL 

INVEN 

MHRS 

7701 

7995 

80 

60 

110 

460 

673 

7702 

8544 

87 

67 

74 

446 

473 

7703 

.  9471 

96 

77 

88 

467 

524 

7704 

9137 

116 

88 

73 

421 

573 

7705 

11443 

136 

102 

60 

467 

363 

7706 

8639 

141 

103 

74 

468 

461 

7707 

7162 

129 

98 

78 

467 

417 

7708 

9712 

120 

91 

60 

456 

446 

7709 

7990 

120 

91 

70 

440 

470 

7710 

6770 

124 

91 

67 

344 

537 

7711 

9117 

130 

96 

46 

444 

355 

7712 

6832 

146 

100 

43 

440 

346 

7801 

6326 

129 

88 

8' 

458 

595 

7802 

8046 

118 

77 

52 

405 

418 

7803 

8940 

126 

79 

49 

462 

372 

7804 

7861 

162 

102 

52 

427 

305 

7805 

8922 

174 

110 

47 

426 

442 

7806 

9260 

168 

114 

56 

665 

382 

7  807 

7231 

157 

100 

59 

456 

491 

7808 

8897 

148 

96 

57 

454 

559 

7809 

8390 

130 

86 

73 

453 

478 

7810 

8323 

130 

92 

67 

458 

403 

7811 

8514 

132 

95 

51 

443 

393 

7812 

7301 

142 

99 

52 

653 

463 

7901 

7349 

142 

101 

60 

402 

364 

7902 

8032 

132 

99 

60 

441 

389 

7903 

9537 

138 

110 

61 

437 

374 

7904 

8846 

147 

110 

59 

442 

491 

7905 

8656 

147 

104 

64 

449 

457 

7906 

8251 

133 

94 

70 

425 

483 

7907 

8397 

140 

100 

48 

443 

435 

7  913 

8891 

158 

117 

44 

416 

317 

7909 

7750 

154 

117 

71 

394 

589 

7910 

8463 

149 

115 

54 

395 

422 

7911 

7303 

126 

98 

62 

410 

523 

7912 

6720 

154 

118 

30 

448 

240 

NRTS 


tappet 


AFBRMC  DATA  BASE 
F4E  DATA  WORK  UNIT  513U0 
DATES  8001-8206  (8007-1-6  MSG) 
CSD  FILE:  F4DU0X2 


YR/MO 

OPTIME 

MTBF 

MTBM 

FAIL 

INVEN 

MHRS 

NRTS 

8001 

7467 

159 

126 

43 

440 

387 

4 

8002 

7237 

180 

149 

46 

437 

326 

5 

8003 

7680 

171 

141 

42 

424 

259 

2 

8004 

7714 

168 

139 

47 

431 

369 

4 

8005 

7465 

147 

122 

66 

446 

395 

2 

8006 

7620 

161 

127 

29 

432 

244 

5 

8007 

8008 

8009 

(DATA  MISSING) 

8010 

8011 

8012 

8101 

7086 

181 

138 

50 

424 

359 

8 

8102 

7638 

179 

131 

45 

398 

389 

6 

8103 

7625 

161 

120 

42 

398 

330 

15 

8104 

7432 

181 

117 

37 

442 

327 

9 

8105 

7395 

195 

128 

36 

374 

299 

11 

8106 

7483 

205 

127 

38 

397 

401 

9 

8107 

7617 

205 

153 

38 

422 

263 

7 

8108 

7795 

185 

139 

50 

441 

443 

11 

8109 

6979 

179 

144 

37 

427 

265 

7 

81 10 

7425 

159 

121 

53 

465 

449 

4 

8111 

6133 

159 

123 

39 

435 

278 

2 

8112 

6845 

142 

107 

52 

432 

517 

4 

8201 

5830 

137 

111 

42 

409 

341 

1 

8202 

6027 

141 

115 

34 

415 

282 

4 

8203 

8022 

173 

141 

39 

441 

407 

11 

8204 

7147 

212 

163 

27 

359 

188 

2 

8205 

6789 

209 

156 

39 

422 

328 

4 

8206 

7319 

213 

157 

34 

400 

269 

0 

V-4 


£3**>~T 


